Jul 03 12:50:33 devstack cinder-volume[75047]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 03 12:50:33 devstack cinder-volume[75047]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 03 12:50:33 devstack cinder-volume[75047]: we strongly recommend against using it for new projects.
Jul 03 12:50:33 devstack cinder-volume[75047]: If you are already using Eventlet, we recommend migrating to a different
Jul 03 12:50:33 devstack cinder-volume[75047]: framework.  For more detail see
Jul 03 12:50:33 devstack cinder-volume[75047]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 03 12:50:33 devstack cinder-volume[75047]:   import eventlet  # noqa
Jul 03 12:50:36 devstack cinder-volume[75047]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75047) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 12:50:36 devstack cinder-volume[75047]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75047) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 12:50:36 devstack cinder-volume[75047]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75047) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 12:50:36 devstack cinder-volume[75047]: INFO dbcounter [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Registered counter for database cinder
Jul 03 12:50:37 devstack cinder-volume[75047]: DEBUG oslo_db.sqlalchemy.engines [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75047) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 12:50:37 devstack cinder-volume[75047]: DEBUG dbcounter [-] [75047] Writer thread running {{(pid=75047) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 12:50:37 devstack cinder-volume[75047]: INFO cinder.rpc [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 03 12:50:37 devstack cinder-volume[75047]: INFO cinder.rpc [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 03 12:50:37 devstack cinder-volume[75047]: DEBUG oslo_db.sqlalchemy.engines [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75047) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 12:50:37 devstack cinder-volume[75047]: INFO cinder.volume.manager [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Determined volume DB was empty at startup.
Jul 03 12:50:37 devstack cinder-volume[75047]: DEBUG cinder.volume.manager [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75047) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 03 12:50:37 devstack cinder-volume[75047]: INFO cinder.volume.manager [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 03 12:50:37 devstack cinder-volume[75047]: WARNING stevedore.named [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 03 12:50:37 devstack cinder-volume[75047]: WARNING castellan.key_manager [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 12:50:37 devstack cinder-volume[75047]: WARNING cinder.keymgr.conf_key_mgr [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 12:50:37 devstack cinder-volume[75047]: DEBUG cinder.volume.drivers.lvm [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75047) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Jul 03 12:50:37 devstack cinder-volume[75047]: DEBUG oslo_concurrency.processutils [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_concurrency.processutils [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] CMD "cinder-rtstool verify" returned: 0 in 0.614s {{(pid=75047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_db.sqlalchemy.engines [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75047) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 12:50:38 devstack cinder-volume[75047]: INFO cinder.rpc [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jul 03 12:50:38 devstack cinder-volume[75047]: INFO cinder.rpc [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jul 03 12:50:38 devstack cinder-volume[75047]: WARNING stevedore.named [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 03 12:50:38 devstack cinder-volume[75047]: WARNING castellan.key_manager [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 12:50:38 devstack cinder-volume[75047]: INFO cinder.volume.manager [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_db.sqlalchemy.engines [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75047) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 12:50:38 devstack cinder-volume[75047]: INFO oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Starting 1 workers
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Started child 75229 {{(pid=75047) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Full set of CONF: {{(pid=75047) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] ******************************************************************************** {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Configuration options gathered from: {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] ================================================================================ {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] allow_availability_zone_fallback = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75229]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] allow_compression_on_image_upload = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] allowed_direct_url_schemes     = [] {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] api_rate_limit                 = True {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] auth_strategy                  = keystone {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] az_cache_duration              = 3600 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_availability_zone      = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_host                   = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_name                   = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_stats_polling_interval = 60 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backup_api_class               = cinder.backup.api.API {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backup_name_template           = backup-%s {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backup_use_same_host           = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backup_use_temp_snapshot       = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] chap_password                  = **** {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] chap_username                  =  {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cinder_internal_tenant_project_id = 04c3168bbe444b09918343500c1ebb51 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cinder_internal_tenant_user_id = 3bd433bed85c49c89e7b7f2e038f13fc {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cloned_volume_same_az          = True {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cluster                        = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] compression_format             = gzip {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] config_dir                     = [] {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] config_source                  = [] {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] control_exchange               = openstack {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] debug                          = True {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] default_availability_zone      = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] default_group_type             = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] default_volume_type            = lvmdriver-1 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] disk_geometry                  = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] driver_client_cert             = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] driver_client_cert_key         = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] driver_data_namespace          = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] driver_ssl_cert_path           = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] driver_ssl_cert_verify         = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] driver_use_ssl                 = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] enable_force_upload            = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] enable_new_services            = True {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] enable_unsupported_driver      = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] enforce_multipath_for_image_xfer = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] filter_function                = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] glance_api_insecure            = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] glance_api_servers             = ['http://192.168.122.98/image'] {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] glance_api_ssl_compression     = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] glance_ca_certificates_file    = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] glance_certfile                = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] glance_keyfile                 = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] glance_num_retries             = 3 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] glance_request_timeout         = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] goodness_function              = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] graceful_shutdown_timeout      = 5 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] group_api_class                = cinder.group.api.API {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] host                           = devstack {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] image_compress_on_upload       = True {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] image_conversion_address_space_limit = 1 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] image_conversion_cpu_limit     = 60 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] image_conversion_disable       = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] image_upload_use_cinder_backend = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] image_upload_use_internal_tenant = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] image_volume_cache_enabled     = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75229]: INFO cinder.volume.manager [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jul 03 12:50:38 devstack sudo[75233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] image_volume_cache_max_count   = 0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] image_volume_cache_max_size_gb = 0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] init_host_max_objects_retrieval = 0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] iscsi_target_flags             =  {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack sudo[75233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:38 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] iscsi_write_cache              = on {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] iser_helper                    = tgtadm {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] iser_ip_address                = 192.168.122.98 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] iser_port                      = 3260 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] log_color                      = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] log_config_append              = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] log_dir                        = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] log_file                       = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] log_options                    = True {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] log_rotate_interval            = 1 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] log_rotate_interval_type       = days {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] log_rotation_type              = none {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] max_age                        = 0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] max_logfile_count              = 30 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] max_logfile_size_mb            = 200 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] max_over_subscription_ratio    = 20.0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] message_reap_interval          = 86400 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] message_ttl                    = 2592000 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] migration_create_volume_timeout_secs = 300 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] monkey_patch                   = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] monkey_patch_modules           = [] {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] my_ip                          = 192.168.122.98 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] no_snapshot_gb_quota           = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] num_iser_scan_tries            = 3 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] num_shell_tries                = 3 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] num_volume_device_scan_tries   = 3 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] nvmeof_conn_info_version       = 1 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] nvmet_ns_id                    = 10 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] nvmet_port_id                  = 1 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] osapi_max_limit                = 1000 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] osapi_volume_ext_list          = [] {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] osapi_volume_listen_port       = 8776 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] osapi_volume_use_ssl           = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] osapi_volume_workers           = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] per_volume_size_limit          = -1 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] periodic_fuzzy_delay           = 60 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] periodic_interval              = 60 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] public_endpoint                = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] publish_errors                 = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] quota_backup_gigabytes         = 1000 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] quota_backups                  = 10 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] quota_gigabytes                = 1000 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] quota_groups                   = 10 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] quota_snapshots                = 10 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] quota_volumes                  = 10 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] rate_limit_burst               = 0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] rate_limit_except_level        = CRITICAL {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] rate_limit_interval            = 0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] reinit_driver_count            = 3 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] replication_device             = **** {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] report_discard_supported       = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] report_interval                = 120 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] reservation_clean_interval     = 86400 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] reservation_expire             = 86400 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] reserved_image_namespaces      = [] {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] reserved_percentage            = 0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] rpc_response_timeout           = 120 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] run_external_periodic_tasks    = True {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] scst_target_driver             = iscsi {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] scst_target_iqn_name           = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] service_down_time              = 720 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] shell_completion               = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] snapshot_name_template         = snapshot-%s {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] snapshot_same_host             = True {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] split_loggers                  = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] state_path                     = /opt/stack/data/cinder {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] storage_availability_zone      = nova {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] storage_protocol               = iSCSI {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] syslog_log_facility            = LOG_USER {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] target_helper                  = lioadm {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] target_ip_address              = 192.168.122.98 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] target_port                    = 3260 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] target_protocol                = iscsi {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] target_secondary_ip_addresses  = [] {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] trace_flags                    = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] transport_url                  = **** {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] until_refresh                  = 0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] use_chap_auth                  = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] use_default_quota_class        = True {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] use_journal                    = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] use_json                       = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] use_multipath_for_image_xfer   = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] use_stderr                     = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] use_syslog                     = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] verify_glance_signatures       = enabled {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] volume_api_class               = cinder.volume.api.API {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] volume_backend_name            = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] volume_clear                   = zero {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] volume_clear_ionice            = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] volume_clear_size              = 0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] volume_copy_bps_limit          = 0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] volume_dd_blocksize            = 1M {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] volume_name_template           = volume-%s {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] volume_service_inithost_offload = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] volume_usage_audit_period      = month {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] zoning_mode                    = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_concurrency.disable_process_locking = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.auth_section = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.auth_type   = password {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.auth_version = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.cache       = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.certfile    = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.include_service_catalog = True {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.insecure    = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.interface   = public {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.keyfile     = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.memcache_password =  {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:38 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.memcache_username =  {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.region_name = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.service_type = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.98/identity {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.backend                  = dogpile.cache.null {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.backend_argument         = **** {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.backend_expiration_time  = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.config_prefix            = cache.oslo {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.debug_cache_backend      = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.enable_retry_client      = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.enable_socket_keepalive  = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.enabled                  = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.expiration_time          = 600 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.hashclient_retry_attempts = 2 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.memcache_dead_retry      = 300 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.memcache_sasl_enabled    = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.password                 = **** {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.proxies                  = [] {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.redis_db                 = 0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.redis_server             = localhost:6379 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.retry_attempts           = 2 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.retry_delay              = 0.0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.socket_keepalive_count   = 1 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.socket_keepalive_idle    = 1 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.socket_keepalive_interval = 1 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.socket_timeout           = 1.0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.tls_allowed_ciphers      = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.tls_cafile               = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.tls_certfile             = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.tls_enabled              = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.tls_keyfile              = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cache.username                 = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] coordination.backend_url       = **** {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] database.asyncio_connection    = **** {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] database.asyncio_slave_connection = **** {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] database.backend               = sqlalchemy {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] database.connection            = **** {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] database.connection_debug      = 0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] database.connection_parameters =  {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] database.connection_recycle_time = 3600 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] database.connection_trace      = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] database.db_inc_retry_interval = True {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] database.db_max_retries        = 20 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] database.db_max_retry_interval = 10 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] database.db_retry_interval     = 1 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] database.max_overflow          = 50 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] database.max_pool_size         = 5 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] database.max_retries           = 10 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] database.mysql_wsrep_sync_wait = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] database.pool_timeout          = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] database.retry_interval        = 10 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] database.slave_connection      = **** {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] database.sqlite_synchronous    = True {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] database.synchronous_reader    = True {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] database.use_db_reconnect      = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] profiler.connection_string     = messaging:// {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] profiler.enabled               = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] profiler.es_doc_type           = notification {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] profiler.es_scroll_size        = 10000 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] profiler.es_scroll_time        = 2m {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] profiler.filter_error_trace    = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] profiler.hmac_keys             = **** {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] profiler.sentinel_service_name = mymaster {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] profiler.socket_timeout        = 0.1 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] profiler.trace_requests        = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] profiler.trace_sqlalchemy      = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] profiler_jaeger.process_tags   = {} {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] profiler_jaeger.service_name_prefix = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] profiler_otlp.service_name_prefix = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_policy.enforce_new_defaults = True {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_policy.enforce_scope      = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_policy.policy_default_rule = default {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] privsep_osbrick.group          = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] privsep_osbrick.helper_command = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] privsep_osbrick.user           = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cinder_sys_admin.group         = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cinder_sys_admin.helper_command = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] cinder_sys_admin.user          = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] service_user.auth_section      = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] service_user.auth_type         = password {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] service_user.cafile            = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] service_user.certfile          = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] service_user.collect_timing    = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] service_user.insecure          = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] service_user.keyfile           = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] service_user.send_service_user_token = True {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] service_user.split_loggers     = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] service_user.timeout           = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] glance.auth_section            = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] glance.auth_type               = password {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] glance.certfile                = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] glance.collect_timing          = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] glance.insecure                = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] glance.keyfile                 = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] glance.region_name             = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] glance.split_loggers           = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] glance.timeout                 = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.backend_availability_zone = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.chap_password = **** {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.chap_username =  {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.disk_geometry = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.driver_client_cert = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.driver_client_cert_key = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.driver_data_namespace = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.driver_use_ssl = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.extra_capabilities = {} {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.filter_function = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.goodness_function = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.iscsi_target_flags =  {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.iscsi_write_cache = on {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.iser_ip_address = 192.168.122.98 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.iser_port     = 3260 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.lvm_share_target = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.lvm_type      = auto {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.num_shell_tries = 3 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.replication_device = **** {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.report_discard_supported = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.reserved_percentage = 0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.target_helper = tgtadm {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.target_ip_address = 192.168.122.98 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.target_port   = 3260 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.target_protocol = iscsi {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.trace_flags   = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.unique_fqdn_network = True {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.use_chap_auth = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.volume_backend_name = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.volume_clear  = zero {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.volume_clear_ionice = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.volume_clear_size = 0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_reports.file_event_handler = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_reports.log_dir           = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.backend_host       = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.chap_password      = **** {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.chap_username      = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.disk_geometry      = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.driver_client_cert = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.extra_capabilities = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.filter_function    = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.goodness_function  = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.iser_helper        = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.iser_port          = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.lvm_type           = auto {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.replication_device = **** {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.report_discard_supported = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.reserved_percentage = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.scst_target_driver = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.storage_protocol   = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.target_ip_address  = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.target_port        = 3260 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.trace_flags        = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.volume_clear       = zero {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] lvmdriver-1.volumes_dir        = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_notifications.driver = [] {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_notifications.retry = -1 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] key_manager.fixed_key          = **** {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] barbican.barbican_api_version  = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] barbican.barbican_endpoint     = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] barbican.barbican_endpoint_type = public {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] barbican.barbican_region_name  = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] barbican.cafile                = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] barbican.certfile              = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] barbican.collect_timing        = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] barbican.insecure              = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] barbican.keyfile               = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] barbican.number_of_retries     = 60 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] barbican.retry_delay           = 1 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] barbican.send_service_user_token = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] barbican.split_loggers         = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] barbican.timeout               = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] barbican.verify_ssl            = True {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] barbican.verify_ssl_path       = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] barbican_service_user.auth_section = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] barbican_service_user.auth_type = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] barbican_service_user.cafile   = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] barbican_service_user.certfile = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] barbican_service_user.collect_timing = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] barbican_service_user.insecure = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] barbican_service_user.keyfile  = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] barbican_service_user.split_loggers = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] barbican_service_user.timeout  = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] vault.approle_role_id          = **** {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] vault.approle_secret_id        = **** {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] vault.kv_mountpoint            = secret {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] vault.kv_path                  = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] vault.kv_version               = 2 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] vault.namespace                = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] vault.root_token_id            = **** {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] vault.ssl_ca_crt_file          = None {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] vault.timeout                  = 60.0 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] vault.use_ssl                  = False {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:50:38 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] ******************************************************************************** {{(pid=75047) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 03 12:50:39 devstack sudo[75233]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:39 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.815s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:39 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:39 devstack sudo[75238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 12:50:39 devstack sudo[75238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:40 devstack sudo[75238]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:40 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.711s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:40 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 12:50:40 devstack cinder-volume[75229]: INFO cinder.brick.local_dev.lvm [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jul 03 12:50:40 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:40 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:40 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:40 devstack sudo[75432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 12:50:40 devstack sudo[75432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:41 devstack sudo[75432]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:41 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.803s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:41 devstack cinder-volume[75229]: DEBUG cinder.brick.local_dev.lvm [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75229) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Jul 03 12:50:41 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:41 devstack sudo[75681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 12:50:41 devstack sudo[75681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:42 devstack sudo[75681]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:42 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.844s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:42 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:42 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:42 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:42 devstack sudo[76010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 12:50:42 devstack sudo[76010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:43 devstack sudo[76010]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:43 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.836s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:43 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:43 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:43 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:43 devstack sudo[76016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jul 03 12:50:43 devstack sudo[76016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:44 devstack sudo[76016]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:44 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 1.111s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:44 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:44 devstack sudo[76019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 12:50:44 devstack sudo[76019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:45 devstack sudo[76019]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:45 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.937s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:45 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:45 devstack sudo[76031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 12:50:45 devstack sudo[76031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:46 devstack sudo[76031]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:46 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.973s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:46 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:46 devstack sudo[76036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:50:46 devstack sudo[76036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:47 devstack sudo[76036]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:47 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.796s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:47 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:47 devstack sudo[76045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 12:50:47 devstack sudo[76045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:48 devstack sudo[76045]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:48 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.780s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:48 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:48 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:48 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:48 devstack sudo[76049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 12:50:48 devstack sudo[76049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:48 devstack cinder-volume[75047]: DEBUG dbcounter [-] [75047] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75047) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:50:49 devstack sudo[76049]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:49 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.972s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:49 devstack cinder-volume[75229]: INFO cinder.volume.drivers.lvm [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jul 03 12:50:49 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:49 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:49 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:49 devstack sudo[76060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 12:50:49 devstack sudo[76060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:50 devstack sudo[76060]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:50 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.926s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:50 devstack cinder-volume[75229]: DEBUG cinder.volume.drivers.lvm [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Updating volume stats {{(pid=75229) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 12:50:50 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:50 devstack sudo[76176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 12:50:50 devstack sudo[76176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:51 devstack sudo[76176]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:51 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.718s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:51 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:51 devstack sudo[76316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:50:51 devstack sudo[76316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:51 devstack sudo[76316]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:51 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.794s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:51 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:51 devstack sudo[76320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 12:50:51 devstack sudo[76320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:52 devstack sudo[76320]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:52 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.898s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:52 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:52 devstack sudo[76324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:50:52 devstack sudo[76324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:53 devstack sudo[76324]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:53 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.740s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:53 devstack cinder-volume[75229]: INFO cinder.volume.driver [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Driver hasn't implemented _init_vendor_properties()
Jul 03 12:50:53 devstack cinder-volume[75229]: DEBUG cinder.volume.driver [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75229) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 03 12:50:53 devstack cinder-volume[75229]: DEBUG oslo_db.sqlalchemy.engines [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75229) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 12:50:53 devstack cinder-volume[75229]: DEBUG dbcounter [-] [75229] Writer thread running {{(pid=75229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 12:50:53 devstack cinder-volume[75229]: DEBUG cinder.db.api [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Building query based on filter {{(pid=75229) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 03 12:50:53 devstack cinder-volume[75229]: DEBUG cinder.image.image_utils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75229) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 03 12:50:53 devstack cinder-volume[75229]: INFO cinder.keymgr.migration [None req-02e81c2f-d939-4dbf-bc37-9cbd10199fcb None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 03 12:50:53 devstack cinder-volume[75229]: DEBUG cinder.volume.drivers.lvm [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Updating volume stats {{(pid=75229) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 12:50:53 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:53 devstack sudo[76328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 12:50:53 devstack sudo[76328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:54 devstack sudo[76328]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:54 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.691s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:54 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:54 devstack sudo[76333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:50:54 devstack sudo[76333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:55 devstack sudo[76333]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:55 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.758s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:55 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:55 devstack sudo[76337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 12:50:55 devstack sudo[76337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:55 devstack sudo[76337]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:55 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.771s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:55 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:55 devstack sudo[76341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:50:55 devstack sudo[76341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:56 devstack sudo[76341]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:56 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.666s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:56 devstack cinder-volume[75229]: DEBUG cinder.manager [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Notifying Schedulers of capabilities ... {{(pid=75229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 12:50:56 devstack cinder-volume[75229]: INFO cinder.volume.manager [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Driver initialization completed successfully.
Jul 03 12:50:56 devstack cinder-volume[75229]: INFO cinder.manager [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Initiating service 2 cleanup
Jul 03 12:50:56 devstack cinder-volume[75229]: INFO cinder.manager [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Service 2 cleanup completed.
Jul 03 12:50:56 devstack cinder-volume[75229]: DEBUG cinder.service [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Creating RPC server for service cinder-volume {{(pid=75229) start /opt/stack/cinder/cinder/service.py:231}}
Jul 03 12:50:56 devstack cinder-volume[75229]: DEBUG cinder.service [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75229) start /opt/stack/cinder/cinder/service.py:237}}
Jul 03 12:50:56 devstack cinder-volume[75229]: INFO cinder.volume.manager [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jul 03 12:50:56 devstack cinder-volume[75229]: DEBUG cinder.volume.drivers.lvm [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Updating volume stats {{(pid=75229) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 12:50:56 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:56 devstack sudo[76344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 12:50:56 devstack sudo[76344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:57 devstack sudo[76344]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:57 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.720s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:57 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:57 devstack sudo[76348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:50:57 devstack sudo[76348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:58 devstack sudo[76348]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:58 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.778s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:58 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:58 devstack sudo[76355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 12:50:58 devstack sudo[76355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:58 devstack sudo[76355]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:58 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.721s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:58 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:50:58 devstack sudo[76412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:50:58 devstack sudo[76412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:50:59 devstack sudo[76412]: pam_unix(sudo:session): session closed for user root
Jul 03 12:50:59 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.679s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:50:59 devstack cinder-volume[75229]: INFO cinder.volume.manager [None req-062ced55-4bfe-4d54-a556-6ba9459a5ade None None] Driver post RPC initialization completed successfully.
Jul 03 12:51:07 devstack cinder-volume[75229]: DEBUG oslo_service.periodic_task [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running periodic task VolumeManager._thread_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:51:07 devstack cinder-volume[75229]: DEBUG cinder.volume.manager [None req-af616184-f933-4a72-8daf-50284cded39d None None] thread count: 6 {{(pid=75229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 12:51:07 devstack cinder-volume[75229]: DEBUG cinder.volume.manager [None req-af616184-f933-4a72-8daf-50284cded39d None None] thread info: [<_MainThread(MainThread, started 139725007630464)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139724896007872)>, <Thread(Thread-3 (stat_writer), started daemon 139724896253824)>, <Thread(Rabbit-heartbeat, started daemon 139724895568000)>, <Thread(Thread-5 (_runner), started daemon 139724895703232)>, <Thread(Thread-7 (_runner), started daemon 139724893705216)>] {{(pid=75229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 12:51:09 devstack cinder-volume[75229]: DEBUG dbcounter [-] [75229] Writing DB stats cinder:SELECT=3 {{(pid=75229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:51:09 devstack cinder-volume[75229]: DEBUG dbcounter [-] [75229] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:52:07 devstack cinder-volume[75229]: DEBUG oslo_service.periodic_task [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:52:07 devstack cinder-volume[75229]: DEBUG cinder.volume.drivers.lvm [None req-af616184-f933-4a72-8daf-50284cded39d None None] Updating volume stats {{(pid=75229) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 12:52:07 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:07 devstack sudo[78184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 12:52:07 devstack sudo[78184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:08 devstack sudo[78184]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:08 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.789s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:08 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:08 devstack sudo[78187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:52:08 devstack sudo[78187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:09 devstack sudo[78187]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:09 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.737s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:09 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:09 devstack sudo[78190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 12:52:09 devstack sudo[78190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:09 devstack sudo[78190]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:09 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.717s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:09 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:52:09 devstack sudo[78193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:52:09 devstack sudo[78193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:52:10 devstack sudo[78193]: pam_unix(sudo:session): session closed for user root
Jul 03 12:52:10 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.787s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:52:10 devstack cinder-volume[75229]: DEBUG cinder.manager [None req-af616184-f933-4a72-8daf-50284cded39d None None] Notifying Schedulers of capabilities ... {{(pid=75229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 12:52:10 devstack cinder-volume[75229]: DEBUG oslo_service.periodic_task [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running periodic task VolumeManager._thread_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:52:10 devstack cinder-volume[75229]: DEBUG cinder.volume.manager [None req-af616184-f933-4a72-8daf-50284cded39d None None] thread count: 6 {{(pid=75229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 12:52:10 devstack cinder-volume[75229]: DEBUG cinder.volume.manager [None req-af616184-f933-4a72-8daf-50284cded39d None None] thread info: [<_MainThread(MainThread, started 139725007630464)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139724896007872)>, <Thread(Thread-3 (stat_writer), started daemon 139724896253824)>, <Thread(Rabbit-heartbeat, started daemon 139724895568000)>, <Thread(Thread-5 (_runner), started daemon 139724895703232)>, <Thread(Thread-7 (_runner), started daemon 139724893705216)>] {{(pid=75229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 12:53:07 devstack cinder-volume[75229]: DEBUG oslo_service.periodic_task [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:53:07 devstack cinder-volume[75229]: DEBUG cinder.volume.drivers.lvm [None req-af616184-f933-4a72-8daf-50284cded39d None None] Updating volume stats {{(pid=75229) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 12:53:07 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:07 devstack sudo[81375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 12:53:07 devstack sudo[81375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:08 devstack sudo[81375]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:08 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.831s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:08 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:08 devstack sudo[81378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:53:08 devstack sudo[81378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:09 devstack sudo[81378]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:09 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.819s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:09 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:09 devstack sudo[81381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 12:53:09 devstack sudo[81381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:09 devstack cinder-volume[75229]: DEBUG dbcounter [-] [75229] Writing DB stats cinder:SELECT=1 {{(pid=75229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:53:09 devstack cinder-volume[75229]: DEBUG dbcounter [-] [75229] Writing DB stats cinder:UPDATE=1 {{(pid=75229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:53:10 devstack sudo[81381]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:10 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.814s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:10 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:53:10 devstack sudo[81384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:53:10 devstack sudo[81384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:53:10 devstack sudo[81384]: pam_unix(sudo:session): session closed for user root
Jul 03 12:53:10 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.752s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:53:10 devstack cinder-volume[75229]: DEBUG cinder.manager [None req-af616184-f933-4a72-8daf-50284cded39d None None] Notifying Schedulers of capabilities ... {{(pid=75229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 12:53:10 devstack cinder-volume[75229]: DEBUG oslo_service.periodic_task [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running periodic task VolumeManager._thread_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:53:10 devstack cinder-volume[75229]: DEBUG cinder.volume.manager [None req-af616184-f933-4a72-8daf-50284cded39d None None] thread count: 6 {{(pid=75229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 12:53:10 devstack cinder-volume[75229]: DEBUG cinder.volume.manager [None req-af616184-f933-4a72-8daf-50284cded39d None None] thread info: [<_MainThread(MainThread, started 139725007630464)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139724896007872)>, <Thread(Thread-3 (stat_writer), started daemon 139724896253824)>, <Thread(Rabbit-heartbeat, started daemon 139724895568000)>, <Thread(Thread-5 (_runner), started daemon 139724895703232)>, <Thread(Thread-7 (_runner), started daemon 139724893705216)>] {{(pid=75229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 12:54:07 devstack cinder-volume[75229]: DEBUG oslo_service.periodic_task [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:54:07 devstack cinder-volume[75229]: DEBUG cinder.volume.drivers.lvm [None req-af616184-f933-4a72-8daf-50284cded39d None None] Updating volume stats {{(pid=75229) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 12:54:07 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:07 devstack sudo[82573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 12:54:07 devstack sudo[82573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:08 devstack sudo[82573]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:08 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.695s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:08 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:08 devstack sudo[82580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:54:08 devstack sudo[82580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:09 devstack sudo[82580]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:09 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.805s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:09 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:09 devstack sudo[82607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 12:54:09 devstack sudo[82607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:09 devstack sudo[82607]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:09 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.717s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:09 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:54:09 devstack sudo[82612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:54:09 devstack sudo[82612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:54:10 devstack sudo[82612]: pam_unix(sudo:session): session closed for user root
Jul 03 12:54:10 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.715s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:54:10 devstack cinder-volume[75229]: DEBUG cinder.manager [None req-af616184-f933-4a72-8daf-50284cded39d None None] Notifying Schedulers of capabilities ... {{(pid=75229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 12:55:07 devstack cinder-volume[75229]: DEBUG oslo_service.periodic_task [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:55:07 devstack cinder-volume[75229]: DEBUG cinder.volume.drivers.lvm [None req-af616184-f933-4a72-8daf-50284cded39d None None] Updating volume stats {{(pid=75229) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 12:55:07 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:07 devstack sudo[84407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 12:55:07 devstack sudo[84407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:08 devstack sudo[84407]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:08 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.698s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:08 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:08 devstack sudo[84410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:55:08 devstack sudo[84410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:09 devstack sudo[84410]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:09 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.743s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:09 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:09 devstack sudo[84416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 12:55:09 devstack sudo[84416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:09 devstack cinder-volume[75229]: DEBUG dbcounter [-] [75229] Writing DB stats cinder:SELECT=1 {{(pid=75229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:55:09 devstack cinder-volume[75229]: DEBUG dbcounter [-] [75229] Writing DB stats cinder:UPDATE=1 {{(pid=75229) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:55:09 devstack sudo[84416]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:09 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.708s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:09 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:55:09 devstack sudo[84441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:55:09 devstack sudo[84441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:55:10 devstack sudo[84441]: pam_unix(sudo:session): session closed for user root
Jul 03 12:55:10 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.779s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:55:10 devstack cinder-volume[75229]: DEBUG cinder.manager [None req-af616184-f933-4a72-8daf-50284cded39d None None] Notifying Schedulers of capabilities ... {{(pid=75229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 12:55:10 devstack cinder-volume[75229]: DEBUG oslo_service.periodic_task [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running periodic task VolumeManager._thread_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:55:10 devstack cinder-volume[75229]: DEBUG cinder.volume.manager [None req-af616184-f933-4a72-8daf-50284cded39d None None] thread count: 6 {{(pid=75229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 12:55:10 devstack cinder-volume[75229]: DEBUG cinder.volume.manager [None req-af616184-f933-4a72-8daf-50284cded39d None None] thread info: [<_MainThread(MainThread, started 139725007630464)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139724896007872)>, <Thread(Thread-3 (stat_writer), started daemon 139724896253824)>, <Thread(Rabbit-heartbeat, started daemon 139724895568000)>, <Thread(Thread-5 (_runner), started daemon 139724895703232)>, <Thread(Thread-7 (_runner), started daemon 139724893705216)>] {{(pid=75229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 12:56:07 devstack cinder-volume[75229]: DEBUG oslo_service.periodic_task [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:56:07 devstack cinder-volume[75229]: DEBUG cinder.volume.drivers.lvm [None req-af616184-f933-4a72-8daf-50284cded39d None None] Updating volume stats {{(pid=75229) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 12:56:07 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:07 devstack sudo[85509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 12:56:07 devstack sudo[85509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:08 devstack sudo[85509]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:08 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.808s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:08 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:08 devstack sudo[85535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:56:08 devstack sudo[85535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:09 devstack sudo[85535]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:09 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.803s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:09 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:09 devstack sudo[85542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 12:56:09 devstack sudo[85542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:10 devstack sudo[85542]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:10 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.891s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:10 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:10 devstack sudo[85556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 12:56:10 devstack sudo[85556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:11 devstack sudo[85556]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:11 devstack cinder-volume[75229]: DEBUG oslo_concurrency.processutils [None req-af616184-f933-4a72-8daf-50284cded39d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.852s {{(pid=75229) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:11 devstack cinder-volume[75229]: DEBUG cinder.manager [None req-af616184-f933-4a72-8daf-50284cded39d None None] Notifying Schedulers of capabilities ... {{(pid=75229) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 12:56:11 devstack cinder-volume[75229]: DEBUG oslo_service.periodic_task [None req-af616184-f933-4a72-8daf-50284cded39d None None] Running periodic task VolumeManager._thread_info {{(pid=75229) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:56:11 devstack cinder-volume[75229]: DEBUG cinder.volume.manager [None req-af616184-f933-4a72-8daf-50284cded39d None None] thread count: 6 {{(pid=75229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 12:56:11 devstack cinder-volume[75229]: DEBUG cinder.volume.manager [None req-af616184-f933-4a72-8daf-50284cded39d None None] thread info: [<_MainThread(MainThread, started 139725007630464)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139724896007872)>, <Thread(Thread-3 (stat_writer), started daemon 139724896253824)>, <Thread(Rabbit-heartbeat, started daemon 139724895568000)>, <Thread(Thread-5 (_runner), started daemon 139724895703232)>, <Thread(Thread-7 (_runner), started daemon 139724893705216)>] {{(pid=75229) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 12:56:17 devstack cinder-volume[75047]: INFO oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Caught SIGTERM, stopping children
Jul 03 12:56:17 devstack cinder-volume[75047]: DEBUG oslo_concurrency.lockutils [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Acquiring lock "singleton_lock" {{(pid=75047) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 12:56:17 devstack cinder-volume[75047]: DEBUG oslo_concurrency.lockutils [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Acquired lock "singleton_lock" {{(pid=75047) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 12:56:17 devstack cinder-volume[75047]: DEBUG oslo_concurrency.lockutils [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Releasing lock "singleton_lock" {{(pid=75047) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 12:56:17 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Stop services. {{(pid=75047) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 03 12:56:17 devstack cinder-volume[75047]: DEBUG oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Killing children. {{(pid=75047) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 03 12:56:17 devstack cinder-volume[75047]: INFO oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Waiting on 1 children to exit
Jul 03 12:56:21 devstack cinder-volume[75229]: DEBUG oslo_concurrency.lockutils [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Acquiring lock "singleton_lock" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 12:56:21 devstack cinder-volume[75229]: DEBUG oslo_concurrency.lockutils [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Acquired lock "singleton_lock" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 12:56:21 devstack cinder-volume[75229]: DEBUG oslo_concurrency.lockutils [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Releasing lock "singleton_lock" {{(pid=75229) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 12:56:21 devstack cinder-volume[75229]: WARNING amqp [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 03 12:56:21 devstack cinder-volume[75229]: WARNING amqp [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 03 12:56:21 devstack cinder-volume[75047]: INFO oslo_service.backend._eventlet.service [None req-56fe61d1-f3ae-414b-ad40-fab181dc0a93 None None] Child 75229 exited with status 0
Jul 03 12:56:22 devstack cinder-volume[85859]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 03 12:56:22 devstack cinder-volume[85859]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 03 12:56:22 devstack cinder-volume[85859]: we strongly recommend against using it for new projects.
Jul 03 12:56:22 devstack cinder-volume[85859]: If you are already using Eventlet, we recommend migrating to a different
Jul 03 12:56:22 devstack cinder-volume[85859]: framework.  For more detail see
Jul 03 12:56:22 devstack cinder-volume[85859]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 03 12:56:22 devstack cinder-volume[85859]:   import eventlet  # noqa
Jul 03 12:56:24 devstack cinder-volume[85859]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85859) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 12:56:24 devstack cinder-volume[85859]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85859) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 12:56:24 devstack cinder-volume[85859]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85859) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 12:56:25 devstack cinder-volume[85859]: INFO dbcounter [None req-84397673-5027-469b-b2d6-4813efc0008f None None] Registered counter for database cinder
Jul 03 12:56:25 devstack cinder-volume[85859]: DEBUG oslo_db.sqlalchemy.engines [None req-84397673-5027-469b-b2d6-4813efc0008f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85859) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 12:56:25 devstack cinder-volume[85859]: DEBUG dbcounter [-] [85859] Writer thread running {{(pid=85859) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 12:56:25 devstack cinder-volume[85859]: INFO cinder.rpc [None req-84397673-5027-469b-b2d6-4813efc0008f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 03 12:56:25 devstack cinder-volume[85859]: INFO cinder.rpc [None req-84397673-5027-469b-b2d6-4813efc0008f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 03 12:56:25 devstack cinder-volume[85859]: DEBUG oslo_db.sqlalchemy.engines [None req-84397673-5027-469b-b2d6-4813efc0008f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85859) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 12:56:25 devstack cinder-volume[85859]: INFO cinder.volume.manager [None req-84397673-5027-469b-b2d6-4813efc0008f None None] Determined volume DB was empty at startup.
Jul 03 12:56:25 devstack cinder-volume[85859]: DEBUG cinder.volume.manager [None req-84397673-5027-469b-b2d6-4813efc0008f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85859) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 03 12:56:25 devstack cinder-volume[85859]: INFO cinder.volume.manager [None req-84397673-5027-469b-b2d6-4813efc0008f None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 03 12:56:25 devstack cinder-volume[85859]: WARNING stevedore.named [None req-84397673-5027-469b-b2d6-4813efc0008f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 03 12:56:25 devstack cinder-volume[85859]: WARNING castellan.key_manager [None req-84397673-5027-469b-b2d6-4813efc0008f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 12:56:25 devstack cinder-volume[85859]: WARNING cinder.keymgr.conf_key_mgr [None req-84397673-5027-469b-b2d6-4813efc0008f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 12:56:25 devstack cinder-volume[85859]: INFO cinder.volume.manager [None req-84397673-5027-469b-b2d6-4813efc0008f None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 03 12:56:25 devstack cinder-volume[85859]: DEBUG oslo_db.sqlalchemy.engines [None req-84397673-5027-469b-b2d6-4813efc0008f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85859) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 12:56:25 devstack cinder-volume[85859]: INFO oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] Starting 1 workers
Jul 03 12:56:25 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] Started child 86074 {{(pid=85859) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 03 12:56:25 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] Full set of CONF: {{(pid=85859) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 03 12:56:25 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] ******************************************************************************** {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 03 12:56:25 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] Configuration options gathered from: {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 03 12:56:25 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 03 12:56:25 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 03 12:56:25 devstack cinder-volume[86074]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 03 12:56:25 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] ================================================================================ {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 03 12:56:25 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] allow_availability_zone_fallback = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:25 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] allow_compression_on_image_upload = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:25 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] allowed_direct_url_schemes     = [] {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:25 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] api_rate_limit                 = True {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:25 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] auth_strategy                  = keystone {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:25 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_availability_zone      = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:25 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_host                   = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:25 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_name                   = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:25 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_stats_polling_interval = 60 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:25 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backup_api_class               = cinder.backup.api.API {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backup_name_template           = backup-%s {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backup_use_same_host           = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backup_use_temp_snapshot       = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] chap_password                  = **** {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] chap_username                  =  {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cinder_internal_tenant_project_id = 04c3168bbe444b09918343500c1ebb51 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cinder_internal_tenant_user_id = 3bd433bed85c49c89e7b7f2e038f13fc {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cluster                        = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] compression_format             = gzip {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] compute_api_class              = cinder.compute.nova.API {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] config_dir                     = [] {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] config_source                  = [] {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] control_exchange               = openstack {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] debug                          = True {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] default_availability_zone      = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] default_group_type             = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] default_volume_type            = QuobyteHD {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] disk_geometry                  = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] driver_client_cert             = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] driver_client_cert_key         = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] driver_data_namespace          = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] driver_ssl_cert_path           = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] driver_ssl_cert_verify         = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] driver_use_ssl                 = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] enable_new_services            = True {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] enable_unsupported_driver      = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] enabled_backends               = ['QuobyteHD'] {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] enforce_multipath_for_image_xfer = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] filter_function                = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] glance_api_insecure            = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] glance_api_servers             = ['http://192.168.122.98/image'] {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] glance_api_ssl_compression     = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] glance_ca_certificates_file    = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] glance_catalog_info            = image:glance:publicURL {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] glance_certfile                = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] glance_keyfile                 = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] glance_num_retries             = 3 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] glance_request_timeout         = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] goodness_function              = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] graceful_shutdown_timeout      = 5 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] group_api_class                = cinder.group.api.API {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] host                           = devstack {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] image_compress_on_upload       = True {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] image_conversion_address_space_limit = 1 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[86074]: INFO cinder.volume.manager [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 03 12:56:26 devstack cinder-volume[86074]: DEBUG cinder.volume.drivers.remotefs [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86074) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] image_conversion_cpu_limit     = 60 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] image_conversion_disable       = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] image_upload_use_cinder_backend = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] image_upload_use_internal_tenant = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] image_volume_cache_enabled     = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] image_volume_cache_max_count   = 0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] image_volume_cache_max_size_gb = 0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] init_host_max_objects_retrieval = 0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] instance_format                = [instance: %(uuid)s]  {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] iscsi_target_flags             =  {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] iscsi_write_cache              = on {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] iser_helper                    = tgtadm {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] iser_ip_address                = 192.168.122.98 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] iser_port                      = 3260 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] log_color                      = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] log_config_append              = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] log_dir                        = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] log_file                       = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] log_options                    = True {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] log_rotate_interval            = 1 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] log_rotate_interval_type       = days {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] log_rotation_type              = none {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] max_age                        = 0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] max_logfile_count              = 30 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] max_logfile_size_mb            = 200 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] max_over_subscription_ratio    = 20.0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] message_reap_interval          = 86400 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] message_ttl                    = 2592000 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] migration_create_volume_timeout_secs = 300 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] monkey_patch                   = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] monkey_patch_modules           = [] {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] my_ip                          = 192.168.122.98 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] no_snapshot_gb_quota           = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] num_iser_scan_tries            = 3 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] num_shell_tries                = 3 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] num_volume_device_scan_tries   = 3 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] nvmeof_conn_info_version       = 1 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] nvmet_ns_id                    = 10 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] nvmet_port_id                  = 1 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] osapi_max_limit                = 1000 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] osapi_volume_ext_list          = [] {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] osapi_volume_listen_port       = 8776 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] osapi_volume_use_ssl           = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] osapi_volume_workers           = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] per_volume_size_limit          = -1 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] periodic_fuzzy_delay           = 60 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] periodic_interval              = 60 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] public_endpoint                = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] publish_errors                 = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] quota_backup_gigabytes         = 1000 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] quota_backups                  = 10 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] quota_gigabytes                = 1000 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] quota_groups                   = 10 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] quota_snapshots                = 10 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] quota_volumes                  = 10 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] rate_limit_burst               = 0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] rate_limit_except_level        = CRITICAL {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] rate_limit_interval            = 0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] reinit_driver_count            = 3 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] replication_device             = **** {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] report_discard_supported       = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] report_interval                = 120 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] reservation_clean_interval     = 86400 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] reservation_expire             = 86400 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] reserved_image_namespaces      = [] {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] reserved_percentage            = 0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] rpc_response_timeout           = 120 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] run_external_periodic_tasks    = True {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] scst_target_driver             = iscsi {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] scst_target_iqn_name           = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] service_down_time              = 720 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] shell_completion               = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] snapshot_name_template         = snapshot-%s {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] split_loggers                  = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] state_path                     = /opt/stack/data/cinder {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] storage_availability_zone      = nova {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] storage_protocol               = iSCSI {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] syslog_log_facility            = LOG_USER {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] target_helper                  = lioadm {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] target_ip_address              = 192.168.122.98 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] target_port                    = 3260 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] target_protocol                = iscsi {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] target_secondary_ip_addresses  = [] {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] trace_flags                    = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] transport_url                  = **** {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] until_refresh                  = 0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] use_chap_auth                  = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] use_default_quota_class        = True {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] use_journal                    = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[86074]: DEBUG cinder.volume.drivers.quobyte [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86074) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 03 12:56:26 devstack cinder-volume[86074]: WARNING cinder.volume.drivers.quobyte [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 03 12:56:26 devstack cinder-volume[86074]: WARNING cinder.volume.drivers.quobyte [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] use_json                       = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] use_multipath_for_image_xfer   = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] use_stderr                     = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] use_syslog                     = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] verify_glance_signatures       = enabled {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] volume_api_class               = cinder.volume.api.API {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[86074]: DEBUG oslo_concurrency.processutils [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Running cmd (subprocess): mount.quobyte {{(pid=86074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] volume_backend_name            = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] volume_clear                   = zero {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] volume_clear_ionice            = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] volume_clear_size              = 0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] volume_copy_bps_limit          = 0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] volume_dd_blocksize            = 1M {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] volume_name_template           = volume-%s {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] volume_service_inithost_offload = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] volume_usage_audit_period      = month {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] zoning_mode                    = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_concurrency.disable_process_locking = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.auth_section = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.auth_type   = password {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.auth_version = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.cache       = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.certfile    = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.delay_auth_decision = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.http_connect_timeout = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.include_service_catalog = True {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.insecure    = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.interface   = public {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.keyfile     = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.memcache_password =  {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.memcache_username =  {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.region_name = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.service_token_roles_required = True {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.service_type = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.token_cache_time = 300 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.98/identity {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.backend                  = dogpile.cache.null {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.backend_argument         = **** {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.backend_expiration_time  = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.config_prefix            = cache.oslo {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.debug_cache_backend      = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.enable_retry_client      = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.enable_socket_keepalive  = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.enabled                  = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.expiration_time          = 600 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.hashclient_retry_attempts = 2 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.memcache_dead_retry      = 300 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.memcache_pool_maxsize    = 10 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.memcache_sasl_enabled    = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.password                 = **** {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.proxies                  = [] {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.redis_db                 = 0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.redis_sentinel_service_name = mymaster {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.redis_server             = localhost:6379 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.retry_attempts           = 2 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.retry_delay              = 0.0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.socket_keepalive_count   = 1 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.socket_keepalive_idle    = 1 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.socket_keepalive_interval = 1 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.socket_timeout           = 1.0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.tls_allowed_ciphers      = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.tls_cafile               = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.tls_certfile             = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.tls_enabled              = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.tls_keyfile              = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cache.username                 = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] coordination.backend_url       = **** {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] database.asyncio_connection    = **** {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] database.asyncio_slave_connection = **** {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] database.backend               = sqlalchemy {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] database.connection            = **** {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] database.connection_debug      = 0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] database.connection_parameters =  {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] database.connection_recycle_time = 3600 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] database.connection_trace      = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] database.db_inc_retry_interval = True {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] database.db_max_retries        = 20 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] database.db_max_retry_interval = 10 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] database.db_retry_interval     = 1 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] database.max_overflow          = 50 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] database.max_pool_size         = 5 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] database.max_retries           = 10 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] database.mysql_wsrep_sync_wait = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] database.pool_timeout          = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] database.retry_interval        = 10 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] database.slave_connection      = **** {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] database.sqlite_synchronous    = True {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] database.synchronous_reader    = True {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] database.use_db_reconnect      = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] profiler.connection_string     = messaging:// {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] profiler.enabled               = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] profiler.es_doc_type           = notification {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] profiler.es_scroll_size        = 10000 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] profiler.es_scroll_time        = 2m {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] profiler.filter_error_trace    = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] profiler.hmac_keys             = **** {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] profiler.sentinel_service_name = mymaster {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] profiler.socket_timeout        = 0.1 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] profiler.trace_requests        = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] profiler.trace_sqlalchemy      = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] profiler_jaeger.process_tags   = {} {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] profiler_jaeger.service_name_prefix = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] profiler_otlp.service_name_prefix = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_policy.enforce_new_defaults = True {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_policy.enforce_scope      = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_policy.policy_default_rule = default {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_policy.policy_file        = policy.yaml {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] privsep_osbrick.group          = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] privsep_osbrick.helper_command = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] privsep_osbrick.user           = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[86074]: DEBUG oslo_concurrency.processutils [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] CMD "mount.quobyte" returned: 1 in 0.116s {{(pid=86074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cinder_sys_admin.group         = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cinder_sys_admin.helper_command = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[86074]: DEBUG oslo_concurrency.lockutils [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86074) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] cinder_sys_admin.user          = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] service_user.auth_section      = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] service_user.auth_type         = password {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] service_user.cafile            = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] service_user.certfile          = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] service_user.collect_timing    = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] service_user.insecure          = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] service_user.keyfile           = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[86074]: DEBUG oslo_concurrency.lockutils [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86074) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] service_user.send_service_user_token = True {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[86074]: DEBUG cinder.volume.drivers.quobyte [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86074) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] service_user.split_loggers     = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] service_user.timeout           = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] glance.auth_section            = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack sudo[86080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff -c /etc/quobyte/client-cinder.cfg
Jul 03 12:56:26 devstack cinder-volume[86074]: INFO cinder.volume.drivers.quobyte [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db ...
Jul 03 12:56:26 devstack sudo[86080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] glance.auth_type               = password {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] glance.certfile                = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] glance.collect_timing          = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] glance.insecure                = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] glance.keyfile                 = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] glance.region_name             = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] glance.split_loggers           = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[86074]: DEBUG oslo_concurrency.processutils [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff -c /etc/quobyte/client-cinder.cfg {{(pid=86074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] glance.timeout                 = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.backend_availability_zone = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.chap_password = **** {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.chap_username =  {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.disk_geometry = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.driver_client_cert = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.driver_client_cert_key = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.driver_data_namespace = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.driver_use_ssl = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.enable_unsupported_driver = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.extra_capabilities = {} {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.filter_function = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.goodness_function = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.iscsi_target_flags =  {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.iscsi_write_cache = on {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.iser_helper   = tgtadm {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.iser_ip_address = 192.168.122.98 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.iser_port     = 3260 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.nas_host      =  {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.nas_login     = admin {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.nas_mount_options = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.nas_password  = **** {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.nas_private_key =  {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.nas_share_path =  {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.num_shell_tries = 3 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.nvmet_port_id = 1 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.quobyte_client_cfg = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.quobyte_volume_url = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.replication_device = **** {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.report_discard_supported = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.reserved_percentage = 0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.scst_target_driver = iscsi {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.scst_target_iqn_name = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.storage_protocol = iSCSI {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.target_helper = tgtadm {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.target_ip_address = 192.168.122.98 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.target_port   = 3260 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.target_protocol = iscsi {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.trace_flags   = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.unique_fqdn_network = True {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.use_chap_auth = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.volume_backend_name = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.volume_clear  = zero {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.volume_clear_ionice = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.volume_clear_size = 0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_reports.file_event_handler = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_reports.log_dir           = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.backend_availability_zone = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.backend_host         = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.chap_password        = **** {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.chap_username        = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.chiscsi_conf         = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.disk_geometry        = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.driver_client_cert   = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.driver_client_cert_key = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.driver_data_namespace = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.driver_use_ssl       = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.extra_capabilities   = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.filter_function      = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.goodness_function    = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.iser_helper          = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.iser_ip_address      = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.iser_port            = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.iser_target_prefix   = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.nas_host             = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.nas_login            = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.nas_mount_options    = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.nas_password         = **** {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.nas_private_key      = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.nas_share_path       = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.nas_ssh_port         = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.num_shell_tries      = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.nvmet_port_id        = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.replication_device   = **** {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.report_discard_supported = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.reserved_percentage  = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.scst_target_driver   = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.storage_protocol     = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.target_helper        = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.target_ip_address    = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.target_port          = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.target_prefix        = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.target_protocol      = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.trace_flags          = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.use_chap_auth        = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.volume_clear         = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.volume_clear_size    = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] QuobyteHD.volumes_dir          = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.ssl      = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_notifications.driver = [] {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_notifications.retry = -1 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] oslo_messaging_notifications.transport_url = **** {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] key_manager.fixed_key          = **** {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] barbican.barbican_api_version  = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] barbican.barbican_endpoint     = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] barbican.barbican_endpoint_type = public {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] barbican.barbican_region_name  = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] barbican.cafile                = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] barbican.certfile              = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] barbican.collect_timing        = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] barbican.insecure              = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] barbican.keyfile               = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] barbican.number_of_retries     = 60 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] barbican.retry_delay           = 1 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] barbican.send_service_user_token = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] barbican.split_loggers         = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] barbican.timeout               = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] barbican.verify_ssl            = True {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] barbican.verify_ssl_path       = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] barbican_service_user.auth_section = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] barbican_service_user.auth_type = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] barbican_service_user.cafile   = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] barbican_service_user.certfile = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] barbican_service_user.collect_timing = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] barbican_service_user.insecure = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] barbican_service_user.keyfile  = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] barbican_service_user.split_loggers = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] barbican_service_user.timeout  = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] vault.approle_role_id          = **** {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] vault.approle_secret_id        = **** {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] vault.kv_mountpoint            = secret {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] vault.kv_path                  = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] vault.kv_version               = 2 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] vault.namespace                = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] vault.root_token_id            = **** {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] vault.ssl_ca_crt_file          = None {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] vault.timeout                  = 60.0 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] vault.use_ssl                  = False {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:26 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] ******************************************************************************** {{(pid=85859) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 03 12:56:27 devstack sudo[86080]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:27 devstack cinder-volume[86074]: DEBUG oslo_concurrency.processutils [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.963s {{(pid=86074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:27 devstack cinder-volume[86074]: INFO cinder.volume.drivers.quobyte [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db succeeded
Jul 03 12:56:27 devstack cinder-volume[86074]: DEBUG cinder.volume.drivers.quobyte [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86074) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:56:27 devstack cinder-volume[86074]: DEBUG oslo_concurrency.lockutils [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.976s {{(pid=86074) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:56:27 devstack cinder-volume[86074]: DEBUG oslo_concurrency.processutils [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:27 devstack sudo[86167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 12:56:27 devstack sudo[86167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:28 devstack sudo[86167]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:28 devstack cinder-volume[86074]: DEBUG oslo_concurrency.processutils [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.843s {{(pid=86074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:28 devstack cinder-volume[86074]: INFO cinder.volume.driver [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Driver hasn't implemented _init_vendor_properties()
Jul 03 12:56:28 devstack cinder-volume[86074]: DEBUG cinder.volume.driver [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6850662231445, 'free_capacity_gb': 1775.6850662231445, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86074) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 03 12:56:28 devstack cinder-volume[86074]: DEBUG oslo_db.sqlalchemy.engines [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86074) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 12:56:28 devstack cinder-volume[86074]: DEBUG dbcounter [-] [86074] Writer thread running {{(pid=86074) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 12:56:28 devstack cinder-volume[86074]: DEBUG cinder.db.api [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Building query based on filter {{(pid=86074) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 03 12:56:28 devstack cinder-volume[86074]: DEBUG cinder.image.image_utils [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86074) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 03 12:56:28 devstack cinder-volume[86074]: INFO cinder.keymgr.migration [None req-36ae6cce-025e-4e37-a357-335f1377b975 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 03 12:56:28 devstack cinder-volume[86074]: DEBUG oslo_concurrency.lockutils [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86074) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:56:28 devstack cinder-volume[86074]: DEBUG oslo_concurrency.lockutils [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86074) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:56:28 devstack cinder-volume[86074]: DEBUG cinder.volume.drivers.quobyte [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86074) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:56:28 devstack cinder-volume[86074]: DEBUG cinder.volume.drivers.quobyte [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86074) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:56:28 devstack cinder-volume[86074]: DEBUG oslo_concurrency.lockutils [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86074) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:56:28 devstack cinder-volume[86074]: DEBUG oslo_concurrency.processutils [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:28 devstack sudo[86186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 12:56:28 devstack sudo[86186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:29 devstack sudo[86186]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:29 devstack cinder-volume[86074]: DEBUG oslo_concurrency.processutils [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.864s {{(pid=86074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:29 devstack cinder-volume[86074]: DEBUG cinder.manager [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Notifying Schedulers of capabilities ... {{(pid=86074) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 12:56:29 devstack cinder-volume[86074]: INFO cinder.volume.manager [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Driver initialization completed successfully.
Jul 03 12:56:29 devstack cinder-volume[86074]: INFO cinder.manager [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Initiating service 3 cleanup
Jul 03 12:56:29 devstack cinder-volume[86074]: INFO cinder.manager [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Service 3 cleanup completed.
Jul 03 12:56:29 devstack cinder-volume[86074]: DEBUG cinder.service [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Creating RPC server for service cinder-volume {{(pid=86074) start /opt/stack/cinder/cinder/service.py:231}}
Jul 03 12:56:29 devstack cinder-volume[86074]: DEBUG cinder.service [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86074) start /opt/stack/cinder/cinder/service.py:237}}
Jul 03 12:56:29 devstack cinder-volume[86074]: INFO cinder.volume.manager [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 03 12:56:29 devstack cinder-volume[86074]: DEBUG oslo_concurrency.lockutils [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86074) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:56:29 devstack cinder-volume[86074]: DEBUG oslo_concurrency.lockutils [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86074) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:56:29 devstack cinder-volume[86074]: DEBUG cinder.volume.drivers.quobyte [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86074) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:56:29 devstack cinder-volume[86074]: DEBUG cinder.volume.drivers.quobyte [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86074) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:56:29 devstack cinder-volume[86074]: DEBUG oslo_concurrency.lockutils [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86074) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:56:29 devstack cinder-volume[86074]: DEBUG oslo_concurrency.processutils [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:29 devstack sudo[86209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 12:56:29 devstack sudo[86209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:30 devstack sudo[86209]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:30 devstack cinder-volume[86074]: DEBUG oslo_concurrency.processutils [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.062s {{(pid=86074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:30 devstack cinder-volume[86074]: INFO cinder.volume.manager [None req-8c195d5a-6cf8-40cd-aedc-2212548c988f None None] Driver post RPC initialization completed successfully.
Jul 03 12:56:34 devstack cinder-volume[86074]: DEBUG oslo_service.periodic_task [None req-21bb2b1d-cffd-42d4-beb2-ca55e05f1a72 None None] Running periodic task VolumeManager._thread_info {{(pid=86074) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:56:34 devstack cinder-volume[86074]: DEBUG cinder.volume.manager [None req-21bb2b1d-cffd-42d4-beb2-ca55e05f1a72 None None] thread count: 6 {{(pid=86074) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 12:56:34 devstack cinder-volume[86074]: DEBUG cinder.volume.manager [None req-21bb2b1d-cffd-42d4-beb2-ca55e05f1a72 None None] thread info: [<_MainThread(MainThread, started 133597233242240)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133597134361664)>, <Thread(Thread-3 (stat_writer), started daemon 133597121635904)>, <Thread(Rabbit-heartbeat, started daemon 133597121950912)>, <Thread(Thread-5 (_runner), started daemon 133597119988480)>, <Thread(Thread-7 (_runner), started daemon 133597120057152)>] {{(pid=86074) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 12:56:35 devstack cinder-volume[86074]: DEBUG oslo_concurrency.lockutils [None req-e86068b5-d437-40ff-af66-30fc50035c4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86074) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:56:35 devstack cinder-volume[86074]: DEBUG oslo_concurrency.lockutils [None req-e86068b5-d437-40ff-af66-30fc50035c4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86074) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:56:35 devstack cinder-volume[86074]: DEBUG cinder.volume.drivers.quobyte [None req-e86068b5-d437-40ff-af66-30fc50035c4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86074) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:56:35 devstack cinder-volume[86074]: DEBUG cinder.volume.drivers.quobyte [None req-e86068b5-d437-40ff-af66-30fc50035c4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86074) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:56:35 devstack cinder-volume[86074]: DEBUG oslo_concurrency.lockutils [None req-e86068b5-d437-40ff-af66-30fc50035c4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86074) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:56:35 devstack cinder-volume[86074]: DEBUG oslo_concurrency.processutils [None req-e86068b5-d437-40ff-af66-30fc50035c4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:35 devstack sudo[86404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 12:56:35 devstack sudo[86404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:35 devstack sudo[86404]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:35 devstack cinder-volume[86074]: DEBUG oslo_concurrency.processutils [None req-e86068b5-d437-40ff-af66-30fc50035c4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.669s {{(pid=86074) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:35 devstack cinder-volume[86074]: DEBUG cinder.manager [None req-e86068b5-d437-40ff-af66-30fc50035c4e None None] Notifying Schedulers of capabilities ... {{(pid=86074) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 12:56:35 devstack cinder-volume[85859]: DEBUG dbcounter [-] [85859] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85859) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:56:38 devstack cinder-volume[85859]: INFO oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] Caught SIGTERM, stopping children
Jul 03 12:56:38 devstack cinder-volume[85859]: DEBUG oslo_concurrency.lockutils [None req-84397673-5027-469b-b2d6-4813efc0008f None None] Acquiring lock "singleton_lock" {{(pid=85859) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 12:56:38 devstack cinder-volume[85859]: DEBUG oslo_concurrency.lockutils [None req-84397673-5027-469b-b2d6-4813efc0008f None None] Acquired lock "singleton_lock" {{(pid=85859) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 12:56:38 devstack cinder-volume[85859]: DEBUG oslo_concurrency.lockutils [None req-84397673-5027-469b-b2d6-4813efc0008f None None] Releasing lock "singleton_lock" {{(pid=85859) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 12:56:38 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] Stop services. {{(pid=85859) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 03 12:56:38 devstack cinder-volume[85859]: DEBUG oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] Killing children. {{(pid=85859) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 03 12:56:38 devstack cinder-volume[85859]: INFO oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] Waiting on 1 children to exit
Jul 03 12:56:40 devstack cinder-volume[86074]: DEBUG dbcounter [-] [86074] Writing DB stats cinder:SELECT=3 {{(pid=86074) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:56:40 devstack cinder-volume[86074]: DEBUG dbcounter [-] [86074] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86074) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:56:42 devstack cinder-volume[86074]: DEBUG oslo_concurrency.lockutils [None req-84397673-5027-469b-b2d6-4813efc0008f None None] Acquiring lock "singleton_lock" {{(pid=86074) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 12:56:42 devstack cinder-volume[86074]: DEBUG oslo_concurrency.lockutils [None req-84397673-5027-469b-b2d6-4813efc0008f None None] Acquired lock "singleton_lock" {{(pid=86074) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 12:56:42 devstack cinder-volume[86074]: DEBUG oslo_concurrency.lockutils [None req-84397673-5027-469b-b2d6-4813efc0008f None None] Releasing lock "singleton_lock" {{(pid=86074) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 12:56:42 devstack cinder-volume[86074]: WARNING amqp [None req-84397673-5027-469b-b2d6-4813efc0008f None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 03 12:56:42 devstack cinder-volume[86074]: WARNING amqp [None req-84397673-5027-469b-b2d6-4813efc0008f None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 03 12:56:42 devstack cinder-volume[85859]: INFO oslo_service.backend._eventlet.service [None req-84397673-5027-469b-b2d6-4813efc0008f None None] Child 86074 exited with status 0
Jul 03 12:56:43 devstack cinder-volume[86560]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 03 12:56:43 devstack cinder-volume[86560]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 03 12:56:43 devstack cinder-volume[86560]: we strongly recommend against using it for new projects.
Jul 03 12:56:43 devstack cinder-volume[86560]: If you are already using Eventlet, we recommend migrating to a different
Jul 03 12:56:43 devstack cinder-volume[86560]: framework.  For more detail see
Jul 03 12:56:43 devstack cinder-volume[86560]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 03 12:56:43 devstack cinder-volume[86560]:   import eventlet  # noqa
Jul 03 12:56:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86560) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 12:56:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86560) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 12:56:46 devstack cinder-volume[86560]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86560) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 12:56:47 devstack cinder-volume[86560]: INFO dbcounter [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] Registered counter for database cinder
Jul 03 12:56:47 devstack cinder-volume[86560]: DEBUG oslo_db.sqlalchemy.engines [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86560) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 12:56:47 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writer thread running {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 12:56:47 devstack cinder-volume[86560]: INFO cinder.rpc [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 03 12:56:47 devstack cinder-volume[86560]: INFO cinder.rpc [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_db.sqlalchemy.engines [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86560) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 12:56:48 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] Determined volume DB was empty at startup.
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG cinder.volume.manager [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86560) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 03 12:56:48 devstack cinder-volume[86560]: WARNING stevedore.named [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 03 12:56:48 devstack cinder-volume[86560]: WARNING castellan.key_manager [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 12:56:48 devstack cinder-volume[86560]: WARNING cinder.keymgr.conf_key_mgr [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 12:56:48 devstack cinder-volume[86560]: INFO cinder.volume.manager [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_db.sqlalchemy.engines [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86560) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 12:56:48 devstack cinder-volume[86560]: INFO oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] Starting 1 workers
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] Started child 86837 {{(pid=86560) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] Full set of CONF: {{(pid=86560) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] ******************************************************************************** {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] Configuration options gathered from: {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] ================================================================================ {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] allow_availability_zone_fallback = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] allow_compression_on_image_upload = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] allowed_direct_url_schemes     = [] {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] api_rate_limit                 = True {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] auth_strategy                  = keystone {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_availability_zone      = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_host                   = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_name                   = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_stats_polling_interval = 60 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backup_api_class               = cinder.backup.api.API {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86837]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backup_name_template           = backup-%s {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backup_use_same_host           = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backup_use_temp_snapshot       = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] chap_password                  = **** {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] chap_username                  =  {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cinder_internal_tenant_project_id = 04c3168bbe444b09918343500c1ebb51 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cinder_internal_tenant_user_id = 3bd433bed85c49c89e7b7f2e038f13fc {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cluster                        = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] compression_format             = gzip {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] config_dir                     = [] {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] config_source                  = [] {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] control_exchange               = openstack {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] debug                          = True {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] default_availability_zone      = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] default_group_type             = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] default_volume_type            = QuobyteHD {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] disk_geometry                  = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] driver_client_cert             = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] driver_client_cert_key         = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] driver_data_namespace          = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] driver_ssl_cert_path           = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] driver_ssl_cert_verify         = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] driver_use_ssl                 = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] enable_new_services            = True {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] enable_unsupported_driver      = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] enforce_multipath_for_image_xfer = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] filter_function                = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] glance_api_insecure            = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] glance_api_servers             = ['http://192.168.122.98/image'] {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] glance_api_ssl_compression     = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] glance_ca_certificates_file    = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] glance_certfile                = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] glance_keyfile                 = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] glance_num_retries             = 3 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] glance_request_timeout         = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] goodness_function              = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] graceful_shutdown_timeout      = 5 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] group_api_class                = cinder.group.api.API {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] host                           = devstack {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] image_compress_on_upload       = True {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] image_conversion_address_space_limit = 1 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] image_conversion_cpu_limit     = 60 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] image_conversion_disable       = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] image_upload_use_cinder_backend = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] image_upload_use_internal_tenant = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] image_volume_cache_enabled     = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] image_volume_cache_max_count   = 0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] image_volume_cache_max_size_gb = 0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] init_host_max_objects_retrieval = 0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] iscsi_target_flags             =  {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] iscsi_write_cache              = on {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] iser_helper                    = tgtadm {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] iser_ip_address                = 192.168.122.98 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] iser_port                      = 3260 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] log_color                      = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] log_config_append              = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] log_dir                        = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] log_file                       = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] log_options                    = True {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] log_rotate_interval            = 1 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] log_rotate_interval_type       = days {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86837) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] log_rotation_type              = none {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] max_age                        = 0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] max_logfile_count              = 30 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] max_logfile_size_mb            = 200 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] max_over_subscription_ratio    = 20.0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] message_reap_interval          = 86400 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] message_ttl                    = 2592000 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] migration_create_volume_timeout_secs = 300 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] monkey_patch                   = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] monkey_patch_modules           = [] {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] my_ip                          = 192.168.122.98 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] no_snapshot_gb_quota           = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] num_iser_scan_tries            = 3 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] num_shell_tries                = 3 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] num_volume_device_scan_tries   = 3 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] nvmeof_conn_info_version       = 1 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] nvmet_ns_id                    = 10 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] nvmet_port_id                  = 1 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] osapi_max_limit                = 1000 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] osapi_volume_ext_list          = [] {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] osapi_volume_listen_port       = 8776 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] osapi_volume_use_ssl           = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] osapi_volume_workers           = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] per_volume_size_limit          = -1 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] periodic_fuzzy_delay           = 60 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] periodic_interval              = 60 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] public_endpoint                = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] publish_errors                 = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] quota_backup_gigabytes         = 1000 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] quota_backups                  = 10 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] quota_gigabytes                = 1000 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] quota_groups                   = 10 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] quota_snapshots                = 10 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] quota_volumes                  = 10 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] rate_limit_burst               = 0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] rate_limit_except_level        = CRITICAL {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] rate_limit_interval            = 0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] reinit_driver_count            = 3 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] replication_device             = **** {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] report_discard_supported       = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] report_interval                = 120 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] reservation_clean_interval     = 86400 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] reservation_expire             = 86400 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] reserved_image_namespaces      = [] {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] reserved_percentage            = 0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] rpc_response_timeout           = 120 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] run_external_periodic_tasks    = True {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] scst_target_driver             = iscsi {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] scst_target_iqn_name           = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] service_down_time              = 720 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] shell_completion               = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] snapshot_name_template         = snapshot-%s {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] split_loggers                  = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] state_path                     = /opt/stack/data/cinder {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] storage_availability_zone      = nova {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] storage_protocol               = iSCSI {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] syslog_log_facility            = LOG_USER {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] target_helper                  = lioadm {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] target_ip_address              = 192.168.122.98 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] target_port                    = 3260 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] target_protocol                = iscsi {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] target_secondary_ip_addresses  = [] {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] trace_flags                    = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] transport_url                  = **** {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] until_refresh                  = 0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] use_chap_auth                  = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] use_default_quota_class        = True {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] use_journal                    = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] use_json                       = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] use_multipath_for_image_xfer   = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] use_stderr                     = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] use_syslog                     = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] verify_glance_signatures       = enabled {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] volume_api_class               = cinder.volume.api.API {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] volume_backend_name            = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] volume_clear                   = zero {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] volume_clear_ionice            = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] volume_clear_size              = 0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] volume_copy_bps_limit          = 0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] volume_dd_blocksize            = 1M {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] volume_name_template           = volume-%s {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] volume_service_inithost_offload = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] volume_usage_audit_period      = month {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] zoning_mode                    = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_concurrency.disable_process_locking = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.auth_section = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.auth_type   = password {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.auth_version = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.cache       = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.certfile    = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.include_service_catalog = True {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.insecure    = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.interface   = public {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.keyfile     = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.memcache_password =  {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86837) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 03 12:56:48 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.quobyte [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.quobyte [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Running cmd (subprocess): mount.quobyte {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.memcache_username =  {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.region_name = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.service_type = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.98/identity {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.backend                  = dogpile.cache.null {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.backend_argument         = **** {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.backend_expiration_time  = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.config_prefix            = cache.oslo {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.debug_cache_backend      = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.enable_retry_client      = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.enable_socket_keepalive  = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.enabled                  = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.expiration_time          = 600 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.hashclient_retry_attempts = 2 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.memcache_dead_retry      = 300 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.memcache_sasl_enabled    = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.password                 = **** {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.proxies                  = [] {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.redis_db                 = 0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.redis_server             = localhost:6379 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.retry_attempts           = 2 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.retry_delay              = 0.0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.socket_keepalive_count   = 1 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.socket_keepalive_idle    = 1 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.socket_keepalive_interval = 1 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.socket_timeout           = 1.0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.tls_allowed_ciphers      = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.tls_cafile               = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.tls_certfile             = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.tls_enabled              = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.tls_keyfile              = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cache.username                 = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] coordination.backend_url       = **** {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] database.asyncio_connection    = **** {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] database.asyncio_slave_connection = **** {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] database.backend               = sqlalchemy {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] database.connection            = **** {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] database.connection_debug      = 0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] database.connection_parameters =  {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] database.connection_recycle_time = 3600 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] database.connection_trace      = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] database.db_inc_retry_interval = True {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] database.db_max_retries        = 20 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] database.db_max_retry_interval = 10 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] database.db_retry_interval     = 1 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] database.max_overflow          = 50 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] database.max_pool_size         = 5 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] database.max_retries           = 10 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] database.mysql_wsrep_sync_wait = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] database.pool_timeout          = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] database.retry_interval        = 10 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] database.slave_connection      = **** {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] database.sqlite_synchronous    = True {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] database.synchronous_reader    = True {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] database.use_db_reconnect      = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] profiler.connection_string     = messaging:// {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] profiler.enabled               = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] profiler.es_doc_type           = notification {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] profiler.es_scroll_size        = 10000 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] profiler.es_scroll_time        = 2m {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] profiler.filter_error_trace    = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] profiler.hmac_keys             = **** {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] profiler.sentinel_service_name = mymaster {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] profiler.socket_timeout        = 0.1 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] profiler.trace_requests        = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] profiler.trace_sqlalchemy      = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] profiler_jaeger.process_tags   = {} {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] profiler_jaeger.service_name_prefix = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] profiler_otlp.service_name_prefix = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_policy.enforce_new_defaults = True {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_policy.enforce_scope      = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_policy.policy_default_rule = default {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] privsep_osbrick.group          = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] privsep_osbrick.helper_command = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] privsep_osbrick.user           = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cinder_sys_admin.group         = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cinder_sys_admin.helper_command = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] cinder_sys_admin.user          = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] service_user.auth_section      = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] service_user.auth_type         = password {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] service_user.cafile            = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] service_user.certfile          = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] service_user.collect_timing    = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack quobyte-client[86840]: Reading configuration file: /etc/quobyte/client.cfg
Jul 03 12:56:48 devstack quobyte-client[86840]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] service_user.insecure          = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] service_user.keyfile           = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] service_user.send_service_user_token = True {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] CMD "mount.quobyte" returned: 1 in 0.064s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] service_user.split_loggers     = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] service_user.timeout           = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] glance.auth_section            = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] glance.auth_type               = password {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:56:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:56:48 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] glance.certfile                = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] glance.collect_timing          = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] glance.insecure                = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] glance.keyfile                 = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] glance.region_name             = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] glance.split_loggers           = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] glance.timeout                 = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.backend_availability_zone = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.chap_password = **** {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.chap_username =  {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.disk_geometry = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.driver_client_cert = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.driver_client_cert_key = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.driver_data_namespace = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.driver_use_ssl = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.extra_capabilities = {} {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.filter_function = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.goodness_function = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.iscsi_target_flags =  {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.iscsi_write_cache = on {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.iser_ip_address = 192.168.122.98 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.iser_port     = 3260 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.nas_host      =  {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.nas_login     = admin {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.nas_mount_options = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.nas_password  = **** {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.nas_private_key =  {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.nas_share_path =  {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.num_shell_tries = 3 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.quobyte_volume_url = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.replication_device = **** {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.report_discard_supported = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.reserved_percentage = 0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.target_helper = tgtadm {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.target_ip_address = 192.168.122.98 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.target_port   = 3260 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.target_protocol = iscsi {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.trace_flags   = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.unique_fqdn_network = True {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.use_chap_auth = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.volume_backend_name = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.volume_clear  = zero {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.volume_clear_ionice = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.volume_clear_size = 0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_reports.file_event_handler = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_reports.log_dir           = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.backend_availability_zone = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.backend_host         = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.chap_password        = **** {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.chap_username        = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.disk_geometry        = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.driver_client_cert   = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.driver_data_namespace = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.extra_capabilities   = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.filter_function      = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.goodness_function    = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack sudo[86841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack sudo[86841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.iser_helper          = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.iser_ip_address      = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.iser_port            = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.nas_host             = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.nas_login            = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.nas_mount_options    = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.nas_password         = **** {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.nas_private_key      = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.nas_share_path       = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.num_shell_tries      = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.replication_device   = **** {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.report_discard_supported = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.reserved_percentage  = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.scst_target_driver   = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.storage_protocol     = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.target_helper        = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.target_ip_address    = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.target_port          = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.target_prefix        = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.target_protocol      = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.trace_flags          = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.use_chap_auth        = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.volume_clear         = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.volume_clear_size    = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] QuobyteHD.volumes_dir          = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_notifications.driver = [] {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_notifications.retry = -1 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] key_manager.fixed_key          = **** {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] barbican.barbican_api_version  = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] barbican.barbican_endpoint     = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] barbican.barbican_endpoint_type = public {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] barbican.barbican_region_name  = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] barbican.cafile                = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] barbican.certfile              = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] barbican.collect_timing        = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] barbican.insecure              = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] barbican.keyfile               = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] barbican.number_of_retries     = 60 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] barbican.retry_delay           = 1 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] barbican.send_service_user_token = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] barbican.split_loggers         = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] barbican.timeout               = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] barbican.verify_ssl            = True {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] barbican.verify_ssl_path       = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] barbican_service_user.auth_section = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] barbican_service_user.auth_type = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] barbican_service_user.cafile   = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] barbican_service_user.certfile = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] barbican_service_user.collect_timing = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] barbican_service_user.insecure = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] barbican_service_user.keyfile  = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] barbican_service_user.split_loggers = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] barbican_service_user.timeout  = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] vault.approle_role_id          = **** {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] vault.approle_secret_id        = **** {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] vault.kv_mountpoint            = secret {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] vault.kv_path                  = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] vault.kv_version               = 2 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] vault.namespace                = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] vault.root_token_id            = **** {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] vault.ssl_ca_crt_file          = None {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] vault.timeout                  = 60.0 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] vault.use_ssl                  = False {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 12:56:48 devstack cinder-volume[86560]: DEBUG oslo_service.backend._eventlet.service [None req-f7dc2137-1023-4ff3-a60c-a45d96bc6042 None None] ******************************************************************************** {{(pid=86560) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 03 12:56:49 devstack sudo[86841]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.675s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:49 devstack cinder-volume[86837]: INFO cinder.volume.driver [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Driver hasn't implemented _init_vendor_properties()
Jul 03 12:56:49 devstack cinder-volume[86837]: DEBUG cinder.volume.driver [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5812377929688, 'free_capacity_gb': 1775.5812377929688, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86837) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 03 12:56:49 devstack cinder-volume[86837]: DEBUG oslo_db.sqlalchemy.engines [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86837) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 12:56:49 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writer thread running {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 12:56:49 devstack cinder-volume[86837]: DEBUG cinder.db.api [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Building query based on filter {{(pid=86837) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 03 12:56:49 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86837) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 03 12:56:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:56:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:56:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:56:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:56:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:56:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:49 devstack cinder-volume[86837]: INFO cinder.keymgr.migration [None req-b1caa2d8-fa5c-498c-b635-5642584fb08c None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 03 12:56:49 devstack sudo[86847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 12:56:49 devstack sudo[86847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:49 devstack sudo[86847]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.695s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:49 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 12:56:50 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Driver initialization completed successfully.
Jul 03 12:56:50 devstack cinder-volume[86837]: INFO cinder.manager [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Initiating service 3 cleanup
Jul 03 12:56:50 devstack cinder-volume[86837]: INFO cinder.manager [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Service 3 cleanup completed.
Jul 03 12:56:50 devstack cinder-volume[86837]: DEBUG cinder.service [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Creating RPC server for service cinder-volume {{(pid=86837) start /opt/stack/cinder/cinder/service.py:231}}
Jul 03 12:56:50 devstack cinder-volume[86837]: DEBUG cinder.service [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86837) start /opt/stack/cinder/cinder/service.py:237}}
Jul 03 12:56:50 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 03 12:56:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:56:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:56:50 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:56:50 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:56:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:56:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:56:50 devstack sudo[86852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 12:56:50 devstack sudo[86852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:56:50 devstack sudo[86852]: pam_unix(sudo:session): session closed for user root
Jul 03 12:56:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.762s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:56:50 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-174e6c3e-eed7-46a9-b180-0130d8709c55 None None] Driver post RPC initialization completed successfully.
Jul 03 12:56:58 devstack cinder-volume[86560]: DEBUG dbcounter [-] [86560] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:57:00 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:57:00 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=3 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:57:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:57:14 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 6 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 12:57:14 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 12:58:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:58:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:58:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:58:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:58:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:58:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:58:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:58:14 devstack sudo[87443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 12:58:14 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:58:17 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root
Jul 03 12:58:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 2.132s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:58:17 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 12:58:17 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:58:17 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 6 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 12:58:17 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 12:58:21 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 12:58:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Flow 'volume_create_manager' (5704441a-30e6-48d9-9aaf-02fefd3cbe6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:58:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee67613-c8c2-4b2a-9718-2e91c3db1f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:58:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee67613-c8c2-4b2a-9718-2e91c3db1f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2069566521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf1e86a-135b-4b21-b00d-a55992e76a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='792dde54d7fd4b24ad4317fe344e7af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:58:21Z,use_quota=True,user_id='a5fb2097d4e34b2a9f7551d74d63201d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:58:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1013308-3939-4e05-bf10-2c7e5d393d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:58:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1013308-3939-4e05-bf10-2c7e5d393d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:58:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c6490b0-f987-4262-ba08-3426eed5acb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:58:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c6490b0-f987-4262-ba08-3426eed5acb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caf1e86a-135b-4b21-b00d-a55992e76a0c', 'volume_name': 'volume-caf1e86a-135b-4b21-b00d-a55992e76a0c', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:58:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac085cb-3c84-4c19-ae8a-c1b62a7f8394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:58:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac085cb-3c84-4c19-ae8a-c1b62a7f8394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:58:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb3fb822-3383-44b9-8964-a87d1e752809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:58:21 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Volume caf1e86a-135b-4b21-b00d-a55992e76a0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caf1e86a-135b-4b21-b00d-a55992e76a0c', 'volume_size': 1}
Jul 03 12:58:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:58:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:58:21 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2069566521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf1e86a-135b-4b21-b00d-a55992e76a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='792dde54d7fd4b24ad4317fe344e7af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:58:21Z,use_quota=True,user_id='a5fb2097d4e34b2a9f7551d74d63201d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 12:58:21 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Creating volume caf1e86a-135b-4b21-b00d-a55992e76a0c {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:58:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:58:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:58:21 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:58:21 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:58:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:58:21 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:58:21 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 12:58:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-caf1e86a-135b-4b21-b00d-a55992e76a0c 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:58:21 devstack sudo[87465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-caf1e86a-135b-4b21-b00d-a55992e76a0c 1073741824
Jul 03 12:58:21 devstack sudo[87465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:58:24 devstack sudo[87465]: pam_unix(sudo:session): session closed for user root
Jul 03 12:58:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-caf1e86a-135b-4b21-b00d-a55992e76a0c 1073741824" returned: 0 in 2.990s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:58:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-caf1e86a-135b-4b21-b00d-a55992e76a0c {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:58:24 devstack sudo[87785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-caf1e86a-135b-4b21-b00d-a55992e76a0c
Jul 03 12:58:25 devstack sudo[87785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:58:27 devstack sudo[87785]: pam_unix(sudo:session): session closed for user root
Jul 03 12:58:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-caf1e86a-135b-4b21-b00d-a55992e76a0c" returned: 0 in 2.175s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:58:27 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] <== create_volume: return (5344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 12:58:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 5.354s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:58:27 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb3fb822-3383-44b9-8964-a87d1e752809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caf1e86a-135b-4b21-b00d-a55992e76a0c', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:58:27 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0015e851-4d84-4012-8d3f-388b69b0e343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:58:27 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Volume volume-caf1e86a-135b-4b21-b00d-a55992e76a0c (caf1e86a-135b-4b21-b00d-a55992e76a0c): created successfully
Jul 03 12:58:27 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0015e851-4d84-4012-8d3f-388b69b0e343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:58:27 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Flow 'volume_create_manager' (5704441a-30e6-48d9-9aaf-02fefd3cbe6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:58:27 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-c73bd028-87ab-441e-a1eb-9b84a049afb9 tempest-DeleteServersTestJSON-1090708210 None] Created volume successfully.
Jul 03 12:58:37 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:58:37 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:58:39 devstack cinder-volume[86837]: WARNING py.warnings [req-2086f9a9-7eb4-47e9-a19d-4e6979bd112c req-ec253f38-e289-4df1-863f-685683cb28e4 tempest-DeleteServersTestJSON-1090708210 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Jul 03 12:58:39 devstack cinder-volume[86837]:   .first()
Jul 03 12:58:39 devstack cinder-volume[86837]: 
Jul 03 12:58:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-2086f9a9-7eb4-47e9-a19d-4e6979bd112c req-ec253f38-e289-4df1-863f-685683cb28e4 tempest-DeleteServersTestJSON-1090708210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:58:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-2086f9a9-7eb4-47e9-a19d-4e6979bd112c req-ec253f38-e289-4df1-863f-685683cb28e4 tempest-DeleteServersTestJSON-1090708210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:58:39 devstack cinder-volume[86837]: INFO oslo.privsep.daemon [req-2086f9a9-7eb4-47e9-a19d-4e6979bd112c req-ec253f38-e289-4df1-863f-685683cb28e4 tempest-DeleteServersTestJSON-1090708210 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpin7il0o5/privsep.sock']
Jul 03 12:58:39 devstack sudo[87917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpin7il0o5/privsep.sock
Jul 03 12:58:39 devstack sudo[87917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:58:40 devstack cinder-volume[86837]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Jul 03 12:58:40 devstack cinder-volume[86837]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 03 12:58:40 devstack cinder-volume[86837]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 03 12:58:40 devstack cinder-volume[86837]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 03 12:58:40 devstack cinder-volume[86837]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 03 12:58:40 devstack cinder-volume[86837]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 03 12:58:40 devstack cinder-volume[86837]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 03 12:58:40 devstack cinder-volume[86837]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 03 12:58:40 devstack cinder-volume[86837]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Jul 03 12:58:42 devstack cinder-volume[86837]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
Jul 03 12:58:42 devstack cinder-volume[86837]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 03 12:58:42 devstack cinder-volume[86837]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 03 12:58:42 devstack cinder-volume[86837]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 03 12:58:42 devstack cinder-volume[86837]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 03 12:58:42 devstack cinder-volume[86837]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 03 12:58:42 devstack cinder-volume[86837]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 03 12:58:42 devstack cinder-volume[86837]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 03 12:58:42 devstack cinder-volume[86837]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
Jul 03 12:58:43 devstack sudo[87917]: pam_unix(sudo:session): session closed for user root
Jul 03 12:58:43 devstack cinder-volume[86837]: INFO oslo.privsep.daemon [req-2086f9a9-7eb4-47e9-a19d-4e6979bd112c req-ec253f38-e289-4df1-863f-685683cb28e4 tempest-DeleteServersTestJSON-1090708210 None] Spawned new privsep daemon via rootwrap
Jul 03 12:58:43 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [req-2086f9a9-7eb4-47e9-a19d-4e6979bd112c req-ec253f38-e289-4df1-863f-685683cb28e4 tempest-DeleteServersTestJSON-1090708210 None] Accepted privsep connection to /tmp/tmpin7il0o5/privsep.sock {{(pid=86837) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jul 03 12:58:43 devstack cinder-volume[86837]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 03 12:58:43 devstack cinder-volume[86837]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 03 12:58:43 devstack cinder-volume[86837]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 03 12:58:43 devstack cinder-volume[86837]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87940
Jul 03 12:58:43 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cd6339-4748-4c00-9756-a0c3fe042963]: (2,) {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:58:43 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36ac13f-ad11-4f7f-bcf3-29b661756bf0]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:58:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-2086f9a9-7eb4-47e9-a19d-4e6979bd112c req-ec253f38-e289-4df1-863f-685683cb28e4 tempest-DeleteServersTestJSON-1090708210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-caf1e86a-135b-4b21-b00d-a55992e76a0c {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:58:43 devstack sudo[87942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-caf1e86a-135b-4b21-b00d-a55992e76a0c
Jul 03 12:58:43 devstack sudo[87942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:58:44 devstack sudo[87942]: pam_unix(sudo:session): session closed for user root
Jul 03 12:58:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-2086f9a9-7eb4-47e9-a19d-4e6979bd112c req-ec253f38-e289-4df1-863f-685683cb28e4 tempest-DeleteServersTestJSON-1090708210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-caf1e86a-135b-4b21-b00d-a55992e76a0c" returned: 0 in 1.420s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:58:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-2086f9a9-7eb4-47e9-a19d-4e6979bd112c req-ec253f38-e289-4df1-863f-685683cb28e4 tempest-DeleteServersTestJSON-1090708210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 5.123s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:58:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-2086f9a9-7eb4-47e9-a19d-4e6979bd112c req-ec253f38-e289-4df1-863f-685683cb28e4 tempest-DeleteServersTestJSON-1090708210 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db', 'name': 'volume-caf1e86a-135b-4b21-b00d-a55992e76a0c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11e7b548-f65a-4e13-b8e0-ca8c4e369126', 'enforce_multipath': True} {{(pid=86837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 12:58:44 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-2086f9a9-7eb4-47e9-a19d-4e6979bd112c req-ec253f38-e289-4df1-863f-685683cb28e4 tempest-DeleteServersTestJSON-1090708210 None] attachment_update completed successfully.
Jul 03 12:58:58 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-34364b00-a772-4ab1-b0a2-9f965a89c30e req-cbf5425c-d203-47a3-94c8-390af562131e tempest-DeleteServersTestJSON-1090708210 None] Terminate volume connection completed successfully.
Jul 03 12:58:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-34364b00-a772-4ab1-b0a2-9f965a89c30e req-cbf5425c-d203-47a3-94c8-390af562131e tempest-DeleteServersTestJSON-1090708210 None] Deleting attachment 11e7b548-f65a-4e13-b8e0-ca8c4e369126. {{(pid=86837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 12:59:00 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 12:59:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Flow 'volume_create_manager' (15ab38eb-8aa6-4651-92f4-3775dcf9b7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:59:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a6418e6-2ca6-40eb-a791-5830a63b2c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a6418e6-2ca6-40eb-a791-5830a63b2c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1011116538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1dbe101-260d-4756-9259-5bd1461cf077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80101b0f698245efb58d972674aab3c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:59:01Z,use_quota=True,user_id='27efed73691d41f1b3b37f28699a21c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee80dc4-bdcd-4fd5-a32c-9f679539d6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee80dc4-bdcd-4fd5-a32c-9f679539d6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a7a6c6-ccd3-4d9d-a65c-b0fae12bbef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a7a6c6-ccd3-4d9d-a65c-b0fae12bbef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1dbe101-260d-4756-9259-5bd1461cf077', 'volume_name': 'volume-c1dbe101-260d-4756-9259-5bd1461cf077', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57b54a63-e455-418e-968c-61bf64635738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57b54a63-e455-418e-968c-61bf64635738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ea7ca70-f4e7-488f-abba-5f185b385703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:00 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Volume c1dbe101-260d-4756-9259-5bd1461cf077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1dbe101-260d-4756-9259-5bd1461cf077', 'volume_size': 1}
Jul 03 12:59:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1011116538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1dbe101-260d-4756-9259-5bd1461cf077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80101b0f698245efb58d972674aab3c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:59:01Z,use_quota=True,user_id='27efed73691d41f1b3b37f28699a21c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 12:59:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Creating volume c1dbe101-260d-4756-9259-5bd1461cf077 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:59:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:59:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:59:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:59:00 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 12:59:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c1dbe101-260d-4756-9259-5bd1461cf077 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:01 devstack sudo[88537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c1dbe101-260d-4756-9259-5bd1461cf077 1073741824
Jul 03 12:59:01 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:02 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c1dbe101-260d-4756-9259-5bd1461cf077 1073741824" returned: 0 in 1.690s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c1dbe101-260d-4756-9259-5bd1461cf077 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:02 devstack sudo[88545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c1dbe101-260d-4756-9259-5bd1461cf077
Jul 03 12:59:02 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:03 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c1dbe101-260d-4756-9259-5bd1461cf077" returned: 0 in 1.188s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:03 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] <== create_volume: return (2983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 12:59:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.994s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:03 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5594d232-f5e7-4931-ae93-f510aa04239b tempest-DeleteServersTestJSON-1090708210 None] Acquiring lock "cinder-caf1e86a-135b-4b21-b00d-a55992e76a0c-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:59:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ea7ca70-f4e7-488f-abba-5f185b385703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1dbe101-260d-4756-9259-5bd1461cf077', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86abad33-e6be-4a4f-8df7-6f95664c0432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5594d232-f5e7-4931-ae93-f510aa04239b tempest-DeleteServersTestJSON-1090708210 None] Lock "cinder-caf1e86a-135b-4b21-b00d-a55992e76a0c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:59:04 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Volume volume-c1dbe101-260d-4756-9259-5bd1461cf077 (c1dbe101-260d-4756-9259-5bd1461cf077): created successfully
Jul 03 12:59:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86abad33-e6be-4a4f-8df7-6f95664c0432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Flow 'volume_create_manager' (15ab38eb-8aa6-4651-92f4-3775dcf9b7af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:59:04 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-8ddf03e5-c8a3-460a-8323-eeae2569ff67 tempest-ServerActionsTestOtherA-276524832 None] Created volume successfully.
Jul 03 12:59:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5594d232-f5e7-4931-ae93-f510aa04239b tempest-DeleteServersTestJSON-1090708210 None] Acquiring lock "cinder-quobyte-caf1e86a-135b-4b21-b00d-a55992e76a0c" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:59:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5594d232-f5e7-4931-ae93-f510aa04239b tempest-DeleteServersTestJSON-1090708210 None] Lock "cinder-quobyte-caf1e86a-135b-4b21-b00d-a55992e76a0c" acquired by "delete_volume" :: waited 0.044s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:59:04 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c183a747-1f7c-4725-8f2e-7ced2567df38]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:59:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5594d232-f5e7-4931-ae93-f510aa04239b tempest-DeleteServersTestJSON-1090708210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-caf1e86a-135b-4b21-b00d-a55992e76a0c {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:04 devstack sudo[88583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-caf1e86a-135b-4b21-b00d-a55992e76a0c
Jul 03 12:59:04 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:05 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5594d232-f5e7-4931-ae93-f510aa04239b tempest-DeleteServersTestJSON-1090708210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-caf1e86a-135b-4b21-b00d-a55992e76a0c" returned: 0 in 1.121s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5594d232-f5e7-4931-ae93-f510aa04239b tempest-DeleteServersTestJSON-1090708210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-caf1e86a-135b-4b21-b00d-a55992e76a0c {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:05 devstack sudo[88590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-caf1e86a-135b-4b21-b00d-a55992e76a0c
Jul 03 12:59:05 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:06 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5594d232-f5e7-4931-ae93-f510aa04239b tempest-DeleteServersTestJSON-1090708210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-caf1e86a-135b-4b21-b00d-a55992e76a0c" returned: 0 in 0.943s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5594d232-f5e7-4931-ae93-f510aa04239b tempest-DeleteServersTestJSON-1090708210 None] Lock "cinder-quobyte-caf1e86a-135b-4b21-b00d-a55992e76a0c" released by "delete_volume" :: held 2.144s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:59:06 devstack cinder-volume[86837]: WARNING cinder.quota [None req-5594d232-f5e7-4931-ae93-f510aa04239b tempest-DeleteServersTestJSON-1090708210 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 03 12:59:06 devstack cinder-volume[86837]: WARNING cinder.quota [None req-5594d232-f5e7-4931-ae93-f510aa04239b tempest-DeleteServersTestJSON-1090708210 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-5594d232-f5e7-4931-ae93-f510aa04239b tempest-DeleteServersTestJSON-1090708210 None] Created reservations ['0fc505a8-faac-4e6c-b651-8603fc2eca22', 'c27be704-5469-40dc-9ff1-54b14f538b82', '45659c16-667c-4613-8f03-6881a8e36f9c', '0899a2b8-9639-489d-95e4-0d790708345b'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Flow 'volume_create_manager' (06093be9-76ef-4ac9-9a04-aa478bb9606a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f3f4ab5-0201-43fb-9183-63bcad2af5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5594d232-f5e7-4931-ae93-f510aa04239b tempest-DeleteServersTestJSON-1090708210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5594d232-f5e7-4931-ae93-f510aa04239b tempest-DeleteServersTestJSON-1090708210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5594d232-f5e7-4931-ae93-f510aa04239b tempest-DeleteServersTestJSON-1090708210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5594d232-f5e7-4931-ae93-f510aa04239b tempest-DeleteServersTestJSON-1090708210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5594d232-f5e7-4931-ae93-f510aa04239b tempest-DeleteServersTestJSON-1090708210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5594d232-f5e7-4931-ae93-f510aa04239b tempest-DeleteServersTestJSON-1090708210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f3f4ab5-0201-43fb-9183-63bcad2af5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1243305534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a891fdac-4c86-4cc7-b90b-725305e029f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f65703565235459aa8ba4ed5049876de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:59:07Z,use_quota=True,user_id='7bce8bca97344e90843217bacd44074b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:06 devstack sudo[88597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 12:59:06 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (630cc922-557e-4e77-a93c-0db8431b30de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (630cc922-557e-4e77-a93c-0db8431b30de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1090d914-6a7d-473a-ac93-c79699a4f7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1090d914-6a7d-473a-ac93-c79699a4f7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a891fdac-4c86-4cc7-b90b-725305e029f7', 'volume_name': 'volume-a891fdac-4c86-4cc7-b90b-725305e029f7', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1564a8b1-2122-4062-964e-5e00ca8d5328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1564a8b1-2122-4062-964e-5e00ca8d5328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24322d70-621f-48a4-82be-613efabe7e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:06 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Volume a891fdac-4c86-4cc7-b90b-725305e029f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a891fdac-4c86-4cc7-b90b-725305e029f7', 'volume_size': 1}
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1243305534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a891fdac-4c86-4cc7-b90b-725305e029f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f65703565235459aa8ba4ed5049876de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:59:07Z,use_quota=True,user_id='7bce8bca97344e90843217bacd44074b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Creating volume a891fdac-4c86-4cc7-b90b-725305e029f7 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:59:06 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 12:59:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a891fdac-4c86-4cc7-b90b-725305e029f7 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:07 devstack sudo[88599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a891fdac-4c86-4cc7-b90b-725305e029f7 1073741824
Jul 03 12:59:07 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:07 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5594d232-f5e7-4931-ae93-f510aa04239b tempest-DeleteServersTestJSON-1090708210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.111s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:07 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-5594d232-f5e7-4931-ae93-f510aa04239b tempest-DeleteServersTestJSON-1090708210 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 12:59:08 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-5594d232-f5e7-4931-ae93-f510aa04239b tempest-DeleteServersTestJSON-1090708210 None] Deleted volume successfully.
Jul 03 12:59:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5594d232-f5e7-4931-ae93-f510aa04239b tempest-DeleteServersTestJSON-1090708210 None] Lock "cinder-caf1e86a-135b-4b21-b00d-a55992e76a0c-delete_volume" released by "delete_volume" :: held 4.005s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:59:08 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a891fdac-4c86-4cc7-b90b-725305e029f7 1073741824" returned: 0 in 1.400s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a891fdac-4c86-4cc7-b90b-725305e029f7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:08 devstack sudo[88610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a891fdac-4c86-4cc7-b90b-725305e029f7
Jul 03 12:59:08 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:09 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a891fdac-4c86-4cc7-b90b-725305e029f7" returned: 0 in 0.998s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] <== create_volume: return (2460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 12:59:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.463s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24322d70-621f-48a4-82be-613efabe7e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a891fdac-4c86-4cc7-b90b-725305e029f7', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (021a98d8-fef5-4202-97af-af9832f5e45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:09 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Volume volume-a891fdac-4c86-4cc7-b90b-725305e029f7 (a891fdac-4c86-4cc7-b90b-725305e029f7): created successfully
Jul 03 12:59:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (021a98d8-fef5-4202-97af-af9832f5e45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Flow 'volume_create_manager' (06093be9-76ef-4ac9-9a04-aa478bb9606a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:59:09 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-1e1d0e8a-9fa6-4fbd-a6e4-dd0fdadbf7d8 tempest-ServersNegativeTestJSON-1398635202 None] Created volume successfully.
Jul 03 12:59:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 12:59:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:59:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:59:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:14 devstack sudo[88635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 12:59:14 devstack sudo[88635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:16 devstack sudo[88635]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.659s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:16 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 12:59:17 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 12:59:17 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Flow 'volume_create_manager' (ce450609-4e40-46c3-a2dc-ebf9e7ad594f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:59:17 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd52c555-808c-414f-b6c8-8ea8981d194a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:17 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd52c555-808c-414f-b6c8-8ea8981d194a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2060866858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8712e97d-0237-4f53-aaed-325186a85dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f65703565235459aa8ba4ed5049876de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:59:17Z,use_quota=True,user_id='7bce8bca97344e90843217bacd44074b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:17 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6c8760-1eea-4cea-a43b-0ef072b959a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:17 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6c8760-1eea-4cea-a43b-0ef072b959a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:17 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6e80e6-d151-4f69-a998-e3b78ba620eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:17 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6e80e6-d151-4f69-a998-e3b78ba620eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8712e97d-0237-4f53-aaed-325186a85dab', 'volume_name': 'volume-8712e97d-0237-4f53-aaed-325186a85dab', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:17 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224dffa2-2acf-4f25-98ac-b7a4c6fd6cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:17 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224dffa2-2acf-4f25-98ac-b7a4c6fd6cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:17 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcabdfc9-fa87-47d4-906b-a84cb1e3ac26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:17 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Volume 8712e97d-0237-4f53-aaed-325186a85dab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8712e97d-0237-4f53-aaed-325186a85dab', 'volume_size': 1}
Jul 03 12:59:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:17 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2060866858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8712e97d-0237-4f53-aaed-325186a85dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f65703565235459aa8ba4ed5049876de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:59:17Z,use_quota=True,user_id='7bce8bca97344e90843217bacd44074b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 12:59:17 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Creating volume 8712e97d-0237-4f53-aaed-325186a85dab {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:59:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:17 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:59:17 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:59:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:17 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:59:17 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 12:59:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8712e97d-0237-4f53-aaed-325186a85dab 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:17 devstack sudo[88639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8712e97d-0237-4f53-aaed-325186a85dab 1073741824
Jul 03 12:59:17 devstack sudo[88639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:18 devstack sudo[88639]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8712e97d-0237-4f53-aaed-325186a85dab 1073741824" returned: 0 in 1.280s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8712e97d-0237-4f53-aaed-325186a85dab {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:18 devstack sudo[88645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8712e97d-0237-4f53-aaed-325186a85dab
Jul 03 12:59:18 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:19 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8712e97d-0237-4f53-aaed-325186a85dab" returned: 0 in 1.005s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:19 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] <== create_volume: return (2364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 12:59:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.366s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcabdfc9-fa87-47d4-906b-a84cb1e3ac26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8712e97d-0237-4f53-aaed-325186a85dab', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b1bf01-510b-4bd7-a991-a16b2e1f8912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:19 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Volume volume-8712e97d-0237-4f53-aaed-325186a85dab (8712e97d-0237-4f53-aaed-325186a85dab): created successfully
Jul 03 12:59:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b1bf01-510b-4bd7-a991-a16b2e1f8912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Flow 'volume_create_manager' (ce450609-4e40-46c3-a2dc-ebf9e7ad594f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:59:19 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-6628c4de-ae4c-4571-bb92-ae8a11a13b7e tempest-ServersNegativeTestJSON-1398635202 None] Created volume successfully.
Jul 03 12:59:21 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7a6db6c7-893d-451f-a1b9-200074ebc987 tempest-ServersNegativeTestJSON-1398635202 None] Acquiring lock "cinder-8712e97d-0237-4f53-aaed-325186a85dab-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:59:21 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7a6db6c7-893d-451f-a1b9-200074ebc987 tempest-ServersNegativeTestJSON-1398635202 None] Lock "cinder-8712e97d-0237-4f53-aaed-325186a85dab-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:59:21 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7a6db6c7-893d-451f-a1b9-200074ebc987 tempest-ServersNegativeTestJSON-1398635202 None] Acquiring lock "cinder-quobyte-8712e97d-0237-4f53-aaed-325186a85dab" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:59:21 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7a6db6c7-893d-451f-a1b9-200074ebc987 tempest-ServersNegativeTestJSON-1398635202 None] Lock "cinder-quobyte-8712e97d-0237-4f53-aaed-325186a85dab" acquired by "delete_volume" :: waited 0.023s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:59:21 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c581c8-1ead-470e-87ef-702ee5376252]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:59:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7a6db6c7-893d-451f-a1b9-200074ebc987 tempest-ServersNegativeTestJSON-1398635202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8712e97d-0237-4f53-aaed-325186a85dab {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:21 devstack sudo[88656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8712e97d-0237-4f53-aaed-325186a85dab
Jul 03 12:59:21 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:22 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7a6db6c7-893d-451f-a1b9-200074ebc987 tempest-ServersNegativeTestJSON-1398635202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8712e97d-0237-4f53-aaed-325186a85dab" returned: 0 in 1.571s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7a6db6c7-893d-451f-a1b9-200074ebc987 tempest-ServersNegativeTestJSON-1398635202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8712e97d-0237-4f53-aaed-325186a85dab {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:23 devstack sudo[88663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8712e97d-0237-4f53-aaed-325186a85dab
Jul 03 12:59:23 devstack sudo[88663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:24 devstack sudo[88663]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7a6db6c7-893d-451f-a1b9-200074ebc987 tempest-ServersNegativeTestJSON-1398635202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8712e97d-0237-4f53-aaed-325186a85dab" returned: 0 in 1.079s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7a6db6c7-893d-451f-a1b9-200074ebc987 tempest-ServersNegativeTestJSON-1398635202 None] Lock "cinder-quobyte-8712e97d-0237-4f53-aaed-325186a85dab" released by "delete_volume" :: held 2.717s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:59:24 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-7a6db6c7-893d-451f-a1b9-200074ebc987 tempest-ServersNegativeTestJSON-1398635202 None] Created reservations ['997748b1-641b-4078-809b-fed3f1b27fa7', '34f1e694-675a-46e6-9c3b-6b675b631903', '2290da7f-0feb-42d7-8659-5f5050d0dde9', 'a692f6e0-555b-4679-a7a2-4dbdc35c0786'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:59:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-7a6db6c7-893d-451f-a1b9-200074ebc987 tempest-ServersNegativeTestJSON-1398635202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-7a6db6c7-893d-451f-a1b9-200074ebc987 tempest-ServersNegativeTestJSON-1398635202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-7a6db6c7-893d-451f-a1b9-200074ebc987 tempest-ServersNegativeTestJSON-1398635202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:59:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-7a6db6c7-893d-451f-a1b9-200074ebc987 tempest-ServersNegativeTestJSON-1398635202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:59:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-7a6db6c7-893d-451f-a1b9-200074ebc987 tempest-ServersNegativeTestJSON-1398635202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7a6db6c7-893d-451f-a1b9-200074ebc987 tempest-ServersNegativeTestJSON-1398635202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:24 devstack sudo[88670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 12:59:24 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e727a1ce-1fbe-41ba-a4c9-036ec57ba0b2 tempest-ServersNegativeTestJSON-1398635202 None] Acquiring lock "cinder-a891fdac-4c86-4cc7-b90b-725305e029f7-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:59:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e727a1ce-1fbe-41ba-a4c9-036ec57ba0b2 tempest-ServersNegativeTestJSON-1398635202 None] Lock "cinder-a891fdac-4c86-4cc7-b90b-725305e029f7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:59:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e727a1ce-1fbe-41ba-a4c9-036ec57ba0b2 tempest-ServersNegativeTestJSON-1398635202 None] Acquiring lock "cinder-quobyte-a891fdac-4c86-4cc7-b90b-725305e029f7" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:59:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e727a1ce-1fbe-41ba-a4c9-036ec57ba0b2 tempest-ServersNegativeTestJSON-1398635202 None] Lock "cinder-quobyte-a891fdac-4c86-4cc7-b90b-725305e029f7" acquired by "delete_volume" :: waited 0.024s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:59:24 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b23de9-0838-4353-852f-1bbef55c6793]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:59:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e727a1ce-1fbe-41ba-a4c9-036ec57ba0b2 tempest-ServersNegativeTestJSON-1398635202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a891fdac-4c86-4cc7-b90b-725305e029f7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:25 devstack sudo[88672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a891fdac-4c86-4cc7-b90b-725305e029f7
Jul 03 12:59:25 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:25 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7a6db6c7-893d-451f-a1b9-200074ebc987 tempest-ServersNegativeTestJSON-1398635202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.336s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:25 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-7a6db6c7-893d-451f-a1b9-200074ebc987 tempest-ServersNegativeTestJSON-1398635202 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 12:59:25 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-7a6db6c7-893d-451f-a1b9-200074ebc987 tempest-ServersNegativeTestJSON-1398635202 None] Deleted volume successfully.
Jul 03 12:59:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7a6db6c7-893d-451f-a1b9-200074ebc987 tempest-ServersNegativeTestJSON-1398635202 None] Lock "cinder-8712e97d-0237-4f53-aaed-325186a85dab-delete_volume" released by "delete_volume" :: held 4.427s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:59:26 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e727a1ce-1fbe-41ba-a4c9-036ec57ba0b2 tempest-ServersNegativeTestJSON-1398635202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a891fdac-4c86-4cc7-b90b-725305e029f7" returned: 0 in 1.815s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e727a1ce-1fbe-41ba-a4c9-036ec57ba0b2 tempest-ServersNegativeTestJSON-1398635202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a891fdac-4c86-4cc7-b90b-725305e029f7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:26 devstack sudo[88718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a891fdac-4c86-4cc7-b90b-725305e029f7
Jul 03 12:59:26 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:28 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e727a1ce-1fbe-41ba-a4c9-036ec57ba0b2 tempest-ServersNegativeTestJSON-1398635202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a891fdac-4c86-4cc7-b90b-725305e029f7" returned: 0 in 1.293s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:28 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e727a1ce-1fbe-41ba-a4c9-036ec57ba0b2 tempest-ServersNegativeTestJSON-1398635202 None] Lock "cinder-quobyte-a891fdac-4c86-4cc7-b90b-725305e029f7" released by "delete_volume" :: held 3.185s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:59:28 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-e727a1ce-1fbe-41ba-a4c9-036ec57ba0b2 tempest-ServersNegativeTestJSON-1398635202 None] Created reservations ['c8ba6d14-866d-4731-b0da-3002d7fce031', '3354c4d6-c1fc-4893-851f-a5a51279adea', '78bf463d-e395-4f96-96ea-fdf46f317ea3', 'bec7dd82-9f4a-4e9a-a394-d43185f9e284'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:59:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e727a1ce-1fbe-41ba-a4c9-036ec57ba0b2 tempest-ServersNegativeTestJSON-1398635202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e727a1ce-1fbe-41ba-a4c9-036ec57ba0b2 tempest-ServersNegativeTestJSON-1398635202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:28 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e727a1ce-1fbe-41ba-a4c9-036ec57ba0b2 tempest-ServersNegativeTestJSON-1398635202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:59:28 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e727a1ce-1fbe-41ba-a4c9-036ec57ba0b2 tempest-ServersNegativeTestJSON-1398635202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:59:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e727a1ce-1fbe-41ba-a4c9-036ec57ba0b2 tempest-ServersNegativeTestJSON-1398635202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e727a1ce-1fbe-41ba-a4c9-036ec57ba0b2 tempest-ServersNegativeTestJSON-1398635202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:28 devstack sudo[88724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 12:59:28 devstack sudo[88724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:30 devstack sudo[88724]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e727a1ce-1fbe-41ba-a4c9-036ec57ba0b2 tempest-ServersNegativeTestJSON-1398635202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 2.060s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:30 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-e727a1ce-1fbe-41ba-a4c9-036ec57ba0b2 tempest-ServersNegativeTestJSON-1398635202 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 12:59:30 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-e727a1ce-1fbe-41ba-a4c9-036ec57ba0b2 tempest-ServersNegativeTestJSON-1398635202 None] Deleted volume successfully.
Jul 03 12:59:30 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e727a1ce-1fbe-41ba-a4c9-036ec57ba0b2 tempest-ServersNegativeTestJSON-1398635202 None] Lock "cinder-a891fdac-4c86-4cc7-b90b-725305e029f7-delete_volume" released by "delete_volume" :: held 5.763s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:59:33 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-967a76ea-8911-40f8-b531-c1ad5b398857 tempest-GroupSnapshotsV319Test-1236453972 None] Group tempest-GroupSnapshotsV319Test-Group-1524294002: creating
Jul 03 12:59:34 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-967a76ea-8911-40f8-b531-c1ad5b398857 tempest-GroupSnapshotsV319Test-1236453972 None] Group tempest-GroupSnapshotsV319Test-Group-1524294002: created successfully
Jul 03 12:59:34 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-967a76ea-8911-40f8-b531-c1ad5b398857 tempest-GroupSnapshotsV319Test-1236453972 None] Create group completed successfully.
Jul 03 12:59:36 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 12:59:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Flow 'volume_create_manager' (7e778221-aaab-4ccb-9d2e-fd477a6f50b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:59:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5663db01-1121-4364-a36f-8be4cac422ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5663db01-1121-4364-a36f-8be4cac422ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T10:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-361107696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=53c52054-8410-45ae-a878-88d7d18b23a8,host='devstack@QuobyteHD#QuobyteHD',id=d9f2fd23-fec5-4122-9e06-6878325630dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64c599959964b319eb684a3350d0a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:59:36Z,use_quota=True,user_id='e390420615254e9da3240ae916f5ae83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(672096f0-9e3d-40fb-99bd-d4ed05cc1377),volume_type_id=672096f0-9e3d-40fb-99bd-d4ed05cc1377)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb60425-c6db-4616-b0a7-9047b387e2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb60425-c6db-4616-b0a7-9047b387e2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f014ba-4892-4920-8510-be0ffd42be1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f014ba-4892-4920-8510-be0ffd42be1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9f2fd23-fec5-4122-9e06-6878325630dc', 'volume_name': 'volume-d9f2fd23-fec5-4122-9e06-6878325630dc', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4044924b-61f5-4c45-bf77-7821a3d3e233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4044924b-61f5-4c45-bf77-7821a3d3e233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27331a64-e761-4bdb-99cd-b798d7c3a41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:36 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Volume d9f2fd23-fec5-4122-9e06-6878325630dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9f2fd23-fec5-4122-9e06-6878325630dc', 'volume_size': 1}
Jul 03 12:59:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=53c52054-8410-45ae-a878-88d7d18b23a8,created_at=2026-07-03T10:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-361107696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=53c52054-8410-45ae-a878-88d7d18b23a8,host='devstack@QuobyteHD#QuobyteHD',id=d9f2fd23-fec5-4122-9e06-6878325630dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64c599959964b319eb684a3350d0a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T10:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T10:59:36Z,use_quota=True,user_id='e390420615254e9da3240ae916f5ae83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(672096f0-9e3d-40fb-99bd-d4ed05cc1377),volume_type_id=672096f0-9e3d-40fb-99bd-d4ed05cc1377)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 12:59:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Creating volume d9f2fd23-fec5-4122-9e06-6878325630dc {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 12:59:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 12:59:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 12:59:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 12:59:36 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 12:59:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:36 devstack sudo[88776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc 1073741824
Jul 03 12:59:36 devstack sudo[88776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:38 devstack sudo[88776]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc 1073741824" returned: 0 in 1.700s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:38 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=35,cinder:UPDATE=36,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:59:38 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=27,cinder:UPDATE=38,cinder:INSERT=11,cinder:DELETE=4 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 12:59:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:38 devstack sudo[88782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc
Jul 03 12:59:38 devstack sudo[88782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:39 devstack sudo[88782]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc" returned: 0 in 1.182s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] <== create_volume: return (2972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 12:59:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.975s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27331a64-e761-4bdb-99cd-b798d7c3a41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9f2fd23-fec5-4122-9e06-6878325630dc', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd391b9-441d-43f6-accc-668993e9e8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 12:59:39 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Volume volume-d9f2fd23-fec5-4122-9e06-6878325630dc (d9f2fd23-fec5-4122-9e06-6878325630dc): created successfully
Jul 03 12:59:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd391b9-441d-43f6-accc-668993e9e8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 12:59:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Flow 'volume_create_manager' (7e778221-aaab-4ccb-9d2e-fd477a6f50b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 12:59:39 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-14e838d1-2ac3-4967-a2a7-f1d01974e1b6 tempest-GroupSnapshotsV319Test-1236453972 None] Created volume successfully.
Jul 03 12:59:41 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-4f6f7503-f807-48fe-96d9-4992b8742e4a tempest-GroupSnapshotsV319Test-1236453972 None] GroupSnapshot dc4f048d-3ea2-4322-8ade-5756f0ed55bf: creating.
Jul 03 12:59:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4f6f7503-f807-48fe-96d9-4992b8742e4a tempest-GroupSnapshotsV319Test-1236453972 None] Group snapshot dc4f048d-3ea2-4322-8ade-5756f0ed55bf: creating. {{(pid=86837) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 03 12:59:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4f6f7503-f807-48fe-96d9-4992b8742e4a tempest-GroupSnapshotsV319Test-1236453972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 12:59:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4f6f7503-f807-48fe-96d9-4992b8742e4a tempest-GroupSnapshotsV319Test-1236453972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 12:59:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-4f6f7503-f807-48fe-96d9-4992b8742e4a tempest-GroupSnapshotsV319Test-1236453972 None] Creating offline snapshot 9312c05a-5bb2-4287-b85d-20c5e7fa9c80 of volume d9f2fd23-fec5-4122-9e06-6878325630dc {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 12:59:41 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef95ed6c-efd5-4025-91ba-8417e02d4c1f]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:59:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4f6f7503-f807-48fe-96d9-4992b8742e4a tempest-GroupSnapshotsV319Test-1236453972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:41 devstack sudo[88807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc
Jul 03 12:59:41 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:43 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4f6f7503-f807-48fe-96d9-4992b8742e4a tempest-GroupSnapshotsV319Test-1236453972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc" returned: 0 in 1.333s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4f6f7503-f807-48fe-96d9-4992b8742e4a tempest-GroupSnapshotsV319Test-1236453972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc.9312c05a-5bb2-4287-b85d-20c5e7fa9c80 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:43 devstack sudo[88812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc.9312c05a-5bb2-4287-b85d-20c5e7fa9c80 1G
Jul 03 12:59:43 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:44 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4f6f7503-f807-48fe-96d9-4992b8742e4a tempest-GroupSnapshotsV319Test-1236453972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc.9312c05a-5bb2-4287-b85d-20c5e7fa9c80 1G" returned: 0 in 1.293s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4f6f7503-f807-48fe-96d9-4992b8742e4a tempest-GroupSnapshotsV319Test-1236453972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f2fd23-fec5-4122-9e06-6878325630dc -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc.9312c05a-5bb2-4287-b85d-20c5e7fa9c80 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:44 devstack sudo[88818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f2fd23-fec5-4122-9e06-6878325630dc -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc.9312c05a-5bb2-4287-b85d-20c5e7fa9c80
Jul 03 12:59:44 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:45 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4f6f7503-f807-48fe-96d9-4992b8742e4a tempest-GroupSnapshotsV319Test-1236453972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f2fd23-fec5-4122-9e06-6878325630dc -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc.9312c05a-5bb2-4287-b85d-20c5e7fa9c80" returned: 0 in 0.988s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:45 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-4f6f7503-f807-48fe-96d9-4992b8742e4a tempest-GroupSnapshotsV319Test-1236453972 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc.9312c05a-5bb2-4287-b85d-20c5e7fa9c80 is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 12:59:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4f6f7503-f807-48fe-96d9-4992b8742e4a tempest-GroupSnapshotsV319Test-1236453972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc.9312c05a-5bb2-4287-b85d-20c5e7fa9c80 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:45 devstack sudo[88823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc.9312c05a-5bb2-4287-b85d-20c5e7fa9c80
Jul 03 12:59:45 devstack sudo[88823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:46 devstack sudo[88823]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4f6f7503-f807-48fe-96d9-4992b8742e4a tempest-GroupSnapshotsV319Test-1236453972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc.9312c05a-5bb2-4287-b85d-20c5e7fa9c80" returned: 0 in 1.179s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4f6f7503-f807-48fe-96d9-4992b8742e4a tempest-GroupSnapshotsV319Test-1236453972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:46 devstack sudo[88832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc.info
Jul 03 12:59:46 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:47 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4f6f7503-f807-48fe-96d9-4992b8742e4a tempest-GroupSnapshotsV319Test-1236453972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc.info" returned: 0 in 0.910s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:47 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-4f6f7503-f807-48fe-96d9-4992b8742e4a tempest-GroupSnapshotsV319Test-1236453972 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 12:59:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4f6f7503-f807-48fe-96d9-4992b8742e4a tempest-GroupSnapshotsV319Test-1236453972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:47 devstack sudo[88837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc.info
Jul 03 12:59:47 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:48 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4f6f7503-f807-48fe-96d9-4992b8742e4a tempest-GroupSnapshotsV319Test-1236453972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc.info" returned: 0 in 1.008s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4f6f7503-f807-48fe-96d9-4992b8742e4a tempest-GroupSnapshotsV319Test-1236453972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.867s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 12:59:48 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-4f6f7503-f807-48fe-96d9-4992b8742e4a tempest-GroupSnapshotsV319Test-1236453972 None] group_snapshot dc4f048d-3ea2-4322-8ade-5756f0ed55bf: created successfully
Jul 03 12:59:50 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-3e1bdf6a-3e5e-483b-a1fb-fec256fb33fe tempest-GroupSnapshotsV319Test-1236453972 None] group_snapshot dc4f048d-3ea2-4322-8ade-5756f0ed55bf: deleting
Jul 03 12:59:50 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3e1bdf6a-3e5e-483b-a1fb-fec256fb33fe tempest-GroupSnapshotsV319Test-1236453972 None] group_snapshot dc4f048d-3ea2-4322-8ade-5756f0ed55bf: deleting {{(pid=86837) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 03 12:59:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3e1bdf6a-3e5e-483b-a1fb-fec256fb33fe tempest-GroupSnapshotsV319Test-1236453972 None] Acquiring lock "cinder-quobyte-d9f2fd23-fec5-4122-9e06-6878325630dc" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:59:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3e1bdf6a-3e5e-483b-a1fb-fec256fb33fe tempest-GroupSnapshotsV319Test-1236453972 None] Lock "cinder-quobyte-d9f2fd23-fec5-4122-9e06-6878325630dc" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:59:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3e1bdf6a-3e5e-483b-a1fb-fec256fb33fe tempest-GroupSnapshotsV319Test-1236453972 None] Acquiring lock "cinder-quobyte-9312c05a-5bb2-4287-b85d-20c5e7fa9c80" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:59:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3e1bdf6a-3e5e-483b-a1fb-fec256fb33fe tempest-GroupSnapshotsV319Test-1236453972 None] Lock "cinder-quobyte-9312c05a-5bb2-4287-b85d-20c5e7fa9c80" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:59:50 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-3e1bdf6a-3e5e-483b-a1fb-fec256fb33fe tempest-GroupSnapshotsV319Test-1236453972 None] Deleting offline snapshot 9312c05a-5bb2-4287-b85d-20c5e7fa9c80 of volume d9f2fd23-fec5-4122-9e06-6878325630dc {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 12:59:50 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-3e1bdf6a-3e5e-483b-a1fb-fec256fb33fe tempest-GroupSnapshotsV319Test-1236453972 None] snapshot_file for this snap is: volume-d9f2fd23-fec5-4122-9e06-6878325630dc.9312c05a-5bb2-4287-b85d-20c5e7fa9c80 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 12:59:50 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9241d06-936a-4054-9986-bdb92fbb1e77]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:59:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3e1bdf6a-3e5e-483b-a1fb-fec256fb33fe tempest-GroupSnapshotsV319Test-1236453972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc.9312c05a-5bb2-4287-b85d-20c5e7fa9c80 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:50 devstack sudo[88841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc.9312c05a-5bb2-4287-b85d-20c5e7fa9c80
Jul 03 12:59:50 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:51 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3e1bdf6a-3e5e-483b-a1fb-fec256fb33fe tempest-GroupSnapshotsV319Test-1236453972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc.9312c05a-5bb2-4287-b85d-20c5e7fa9c80" returned: 0 in 1.305s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-3e1bdf6a-3e5e-483b-a1fb-fec256fb33fe tempest-GroupSnapshotsV319Test-1236453972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9f2fd23-fec5-4122-9e06-6878325630dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 12:59:51 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1aa3a8-7ffa-4ced-822a-0122ad0f373d]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:59:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3e1bdf6a-3e5e-483b-a1fb-fec256fb33fe tempest-GroupSnapshotsV319Test-1236453972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:51 devstack sudo[88848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc
Jul 03 12:59:51 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:53 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3e1bdf6a-3e5e-483b-a1fb-fec256fb33fe tempest-GroupSnapshotsV319Test-1236453972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc" returned: 0 in 1.584s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3e1bdf6a-3e5e-483b-a1fb-fec256fb33fe tempest-GroupSnapshotsV319Test-1236453972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc.9312c05a-5bb2-4287-b85d-20c5e7fa9c80 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:53 devstack sudo[88857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc.9312c05a-5bb2-4287-b85d-20c5e7fa9c80
Jul 03 12:59:53 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:54 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3e1bdf6a-3e5e-483b-a1fb-fec256fb33fe tempest-GroupSnapshotsV319Test-1236453972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc.9312c05a-5bb2-4287-b85d-20c5e7fa9c80" returned: 0 in 1.266s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3e1bdf6a-3e5e-483b-a1fb-fec256fb33fe tempest-GroupSnapshotsV319Test-1236453972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc.9312c05a-5bb2-4287-b85d-20c5e7fa9c80 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:54 devstack sudo[88881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc.9312c05a-5bb2-4287-b85d-20c5e7fa9c80
Jul 03 12:59:54 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:55 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3e1bdf6a-3e5e-483b-a1fb-fec256fb33fe tempest-GroupSnapshotsV319Test-1236453972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc.9312c05a-5bb2-4287-b85d-20c5e7fa9c80" returned: 0 in 1.225s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3e1bdf6a-3e5e-483b-a1fb-fec256fb33fe tempest-GroupSnapshotsV319Test-1236453972 None] Lock "cinder-quobyte-9312c05a-5bb2-4287-b85d-20c5e7fa9c80" released by "_delete_snapshot" :: held 5.621s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:59:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3e1bdf6a-3e5e-483b-a1fb-fec256fb33fe tempest-GroupSnapshotsV319Test-1236453972 None] Lock "cinder-quobyte-d9f2fd23-fec5-4122-9e06-6878325630dc" released by "delete_snapshot" :: held 5.664s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 12:59:55 devstack cinder-volume[86837]: WARNING cinder.quota [None req-3e1bdf6a-3e5e-483b-a1fb-fec256fb33fe tempest-GroupSnapshotsV319Test-1236453972 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-623869175 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-623869175, it is now deprecated. Please use the default quota class for default quota.
Jul 03 12:59:55 devstack cinder-volume[86837]: WARNING cinder.quota [None req-3e1bdf6a-3e5e-483b-a1fb-fec256fb33fe tempest-GroupSnapshotsV319Test-1236453972 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-623869175 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-623869175, it is now deprecated. Please use the default quota class for default quota.
Jul 03 12:59:55 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-3e1bdf6a-3e5e-483b-a1fb-fec256fb33fe tempest-GroupSnapshotsV319Test-1236453972 None] Created reservations ['30f63728-9ab9-4cb0-a2e0-2039ca7d9096', 'cb2f2258-79ec-497b-9488-0eb83861a031', '170f5304-1e8d-447a-bacd-9e33b45eee0f', 'ccf09677-2166-4527-8081-a1850688bb80'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 12:59:56 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-3e1bdf6a-3e5e-483b-a1fb-fec256fb33fe tempest-GroupSnapshotsV319Test-1236453972 None] group_snapshot dc4f048d-3ea2-4322-8ade-5756f0ed55bf: deleted successfully
Jul 03 12:59:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d1ad3809-21f3-4cd1-b6f7-35b0aad09cc6 tempest-GroupSnapshotsV319Test-1236453972 None] Acquiring lock "cinder-quobyte-d9f2fd23-fec5-4122-9e06-6878325630dc" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 12:59:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d1ad3809-21f3-4cd1-b6f7-35b0aad09cc6 tempest-GroupSnapshotsV319Test-1236453972 None] Lock "cinder-quobyte-d9f2fd23-fec5-4122-9e06-6878325630dc" acquired by "delete_volume" :: waited 0.016s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 12:59:57 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff718e4-b35a-4d14-9cc1-82f9fa094a8c]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 12:59:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d1ad3809-21f3-4cd1-b6f7-35b0aad09cc6 tempest-GroupSnapshotsV319Test-1236453972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:57 devstack sudo[88907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc
Jul 03 12:59:57 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:58 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d1ad3809-21f3-4cd1-b6f7-35b0aad09cc6 tempest-GroupSnapshotsV319Test-1236453972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc" returned: 0 in 1.253s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d1ad3809-21f3-4cd1-b6f7-35b0aad09cc6 tempest-GroupSnapshotsV319Test-1236453972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 12:59:58 devstack sudo[88913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc
Jul 03 12:59:58 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 12:59:59 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root
Jul 03 12:59:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d1ad3809-21f3-4cd1-b6f7-35b0aad09cc6 tempest-GroupSnapshotsV319Test-1236453972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9f2fd23-fec5-4122-9e06-6878325630dc" returned: 0 in 1.056s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 12:59:59 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d1ad3809-21f3-4cd1-b6f7-35b0aad09cc6 tempest-GroupSnapshotsV319Test-1236453972 None] Lock "cinder-quobyte-d9f2fd23-fec5-4122-9e06-6878325630dc" released by "delete_volume" :: held 2.391s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:00:00 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-d1ad3809-21f3-4cd1-b6f7-35b0aad09cc6 tempest-GroupSnapshotsV319Test-1236453972 None] Created reservations ['deb525bf-bc83-4946-9619-46f427eadbe2'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:00:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-d97d3772-facc-486c-a2ac-db3141389705 req-d9cfe732-a2c1-4d26-8bd4-4edb35c66ed9 tempest-ServerActionsTestOtherA-276524832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-d97d3772-facc-486c-a2ac-db3141389705 req-d9cfe732-a2c1-4d26-8bd4-4edb35c66ed9 tempest-ServerActionsTestOtherA-276524832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.026s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:00 devstack cinder-volume[86837]: WARNING cinder.quota [None req-d1ad3809-21f3-4cd1-b6f7-35b0aad09cc6 tempest-GroupSnapshotsV319Test-1236453972 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-623869175 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-623869175, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:00:00 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb8f58a-70a1-4a6e-a5e5-fb5276dd532e]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:00:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-d97d3772-facc-486c-a2ac-db3141389705 req-d9cfe732-a2c1-4d26-8bd4-4edb35c66ed9 tempest-ServerActionsTestOtherA-276524832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c1dbe101-260d-4756-9259-5bd1461cf077 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:00 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-d1ad3809-21f3-4cd1-b6f7-35b0aad09cc6 tempest-GroupSnapshotsV319Test-1236453972 None] Created reservations ['852a73d1-88e5-4aa5-96f5-41e9355848b1', '80a45aa3-cf38-464c-9d86-1998790d20c0', 'e4e0b57f-80cf-46b4-8b36-bf4d4d7750f8', 'a85d7410-8dde-4936-8516-b19f98a94d6c'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:00:00 devstack sudo[88931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c1dbe101-260d-4756-9259-5bd1461cf077
Jul 03 13:00:00 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d1ad3809-21f3-4cd1-b6f7-35b0aad09cc6 tempest-GroupSnapshotsV319Test-1236453972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d1ad3809-21f3-4cd1-b6f7-35b0aad09cc6 tempest-GroupSnapshotsV319Test-1236453972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d1ad3809-21f3-4cd1-b6f7-35b0aad09cc6 tempest-GroupSnapshotsV319Test-1236453972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:00:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d1ad3809-21f3-4cd1-b6f7-35b0aad09cc6 tempest-GroupSnapshotsV319Test-1236453972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:00:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d1ad3809-21f3-4cd1-b6f7-35b0aad09cc6 tempest-GroupSnapshotsV319Test-1236453972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d1ad3809-21f3-4cd1-b6f7-35b0aad09cc6 tempest-GroupSnapshotsV319Test-1236453972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:00 devstack sudo[88933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:00:00 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:01 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-d97d3772-facc-486c-a2ac-db3141389705 req-d9cfe732-a2c1-4d26-8bd4-4edb35c66ed9 tempest-ServerActionsTestOtherA-276524832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c1dbe101-260d-4756-9259-5bd1461cf077" returned: 0 in 1.567s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-d97d3772-facc-486c-a2ac-db3141389705 req-d9cfe732-a2c1-4d26-8bd4-4edb35c66ed9 tempest-ServerActionsTestOtherA-276524832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.650s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:01 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-d97d3772-facc-486c-a2ac-db3141389705 req-d9cfe732-a2c1-4d26-8bd4-4edb35c66ed9 tempest-ServerActionsTestOtherA-276524832 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db', 'name': 'volume-c1dbe101-260d-4756-9259-5bd1461cf077', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d3a278f-fd85-4193-b58f-e20585c44da3', 'enforce_multipath': True} {{(pid=86837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 13:00:02 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d1ad3809-21f3-4cd1-b6f7-35b0aad09cc6 tempest-GroupSnapshotsV319Test-1236453972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.385s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:02 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-d1ad3809-21f3-4cd1-b6f7-35b0aad09cc6 tempest-GroupSnapshotsV319Test-1236453972 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:00:02 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-d1ad3809-21f3-4cd1-b6f7-35b0aad09cc6 tempest-GroupSnapshotsV319Test-1236453972 None] Delete group completed successfully.
Jul 03 13:00:02 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-d97d3772-facc-486c-a2ac-db3141389705 req-d9cfe732-a2c1-4d26-8bd4-4edb35c66ed9 tempest-ServerActionsTestOtherA-276524832 None] attachment_update completed successfully.
Jul 03 13:00:08 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:00:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Flow 'volume_create_manager' (8336808c-eb30-4dd3-a359-01dae80e84ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:00:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930c7a3f-64bf-4d4a-b8cf-2cdb771cdef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930c7a3f-64bf-4d4a-b8cf-2cdb771cdef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1404018478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5704822c-ed41-4c9b-bae8-1d90b586cce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74fbb54230694ca29c121110334fd9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:00:08Z,use_quota=True,user_id='a941584700d94071996ef91b52a190e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c31b4d3-92aa-4e9b-aa80-c2e34135fcd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c31b4d3-92aa-4e9b-aa80-c2e34135fcd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd657279-32fa-4178-a6a5-6f8a28a742d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd657279-32fa-4178-a6a5-6f8a28a742d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5704822c-ed41-4c9b-bae8-1d90b586cce2', 'volume_name': 'volume-5704822c-ed41-4c9b-bae8-1d90b586cce2', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a23072-ad8a-4a9d-a3dd-b560e0844875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a23072-ad8a-4a9d-a3dd-b560e0844875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00a6a86-27a4-4bc5-b45d-0d2bb9780726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:08 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Volume 5704822c-ed41-4c9b-bae8-1d90b586cce2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5704822c-ed41-4c9b-bae8-1d90b586cce2', 'volume_size': 1}
Jul 03 13:00:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1404018478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5704822c-ed41-4c9b-bae8-1d90b586cce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74fbb54230694ca29c121110334fd9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:00:08Z,use_quota=True,user_id='a941584700d94071996ef91b52a190e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:00:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Creating volume 5704822c-ed41-4c9b-bae8-1d90b586cce2 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:00:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:00:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:00:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:00:08 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:00:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5704822c-ed41-4c9b-bae8-1d90b586cce2 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:08 devstack sudo[89431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5704822c-ed41-4c9b-bae8-1d90b586cce2 1073741824
Jul 03 13:00:08 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:10 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5704822c-ed41-4c9b-bae8-1d90b586cce2 1073741824" returned: 0 in 2.261s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5704822c-ed41-4c9b-bae8-1d90b586cce2 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:10 devstack sudo[89440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5704822c-ed41-4c9b-bae8-1d90b586cce2
Jul 03 13:00:10 devstack sudo[89440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:11 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-f76cced6-1274-4054-ab37-09aa2bf7caff tempest-GroupsV320Test-541244149 None] Group tempest-GroupsV320Test-Group-294254058: creating
Jul 03 13:00:11 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-f76cced6-1274-4054-ab37-09aa2bf7caff tempest-GroupsV320Test-541244149 None] Group tempest-GroupsV320Test-Group-294254058: created successfully
Jul 03 13:00:11 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-f76cced6-1274-4054-ab37-09aa2bf7caff tempest-GroupsV320Test-541244149 None] Create group completed successfully.
Jul 03 13:00:11 devstack sudo[89440]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5704822c-ed41-4c9b-bae8-1d90b586cce2" returned: 0 in 1.059s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:12 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] <== create_volume: return (3440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:00:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.485s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:12 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00a6a86-27a4-4bc5-b45d-0d2bb9780726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5704822c-ed41-4c9b-bae8-1d90b586cce2', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:12 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16ce91c2-b6cd-4d2b-8038-8db8bf69dc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:12 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Volume volume-5704822c-ed41-4c9b-bae8-1d90b586cce2 (5704822c-ed41-4c9b-bae8-1d90b586cce2): created successfully
Jul 03 13:00:12 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16ce91c2-b6cd-4d2b-8038-8db8bf69dc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:12 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Flow 'volume_create_manager' (8336808c-eb30-4dd3-a359-01dae80e84ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:00:12 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-5b3329de-e33d-4b65-9132-69a58a574d3d tempest-VolumesAdminNegativeTest-106883733 None] Created volume successfully.
Jul 03 13:00:12 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-ad9c86fc-b4b1-480d-aca3-305f4bc22ff0 req-d2263dfc-de9e-4ac3-bb42-52f75a0fa598 tempest-ServerActionsTestOtherA-276524832 None] Terminate volume connection completed successfully.
Jul 03 13:00:12 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-ad9c86fc-b4b1-480d-aca3-305f4bc22ff0 req-d2263dfc-de9e-4ac3-bb42-52f75a0fa598 tempest-ServerActionsTestOtherA-276524832 None] Deleting attachment 3d3a278f-fd85-4193-b58f-e20585c44da3. {{(pid=86837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:00:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8c1d635d-f1c4-4cf3-a1cb-5b4e2dfc7613 tempest-VolumesAdminNegativeTest-106883733 None] Acquiring lock "cinder-5704822c-ed41-4c9b-bae8-1d90b586cce2-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:00:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8c1d635d-f1c4-4cf3-a1cb-5b4e2dfc7613 tempest-VolumesAdminNegativeTest-106883733 None] Lock "cinder-5704822c-ed41-4c9b-bae8-1d90b586cce2-delete_volume" acquired by "delete_volume" :: waited 0.157s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:00:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8c1d635d-f1c4-4cf3-a1cb-5b4e2dfc7613 tempest-VolumesAdminNegativeTest-106883733 None] Acquiring lock "cinder-quobyte-5704822c-ed41-4c9b-bae8-1d90b586cce2" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:00:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8c1d635d-f1c4-4cf3-a1cb-5b4e2dfc7613 tempest-VolumesAdminNegativeTest-106883733 None] Lock "cinder-quobyte-5704822c-ed41-4c9b-bae8-1d90b586cce2" acquired by "delete_volume" :: waited 0.047s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:00:14 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-6d14d484-c8c9-471a-a773-fe3f13c787e3 tempest-GroupsV320Test-541244149 None] Created reservations ['949c44cb-e4d7-4b06-9c25-ab239eb6ced3'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:00:14 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[409eef38-7234-4ef0-95b1-0402925efc99]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:00:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8c1d635d-f1c4-4cf3-a1cb-5b4e2dfc7613 tempest-VolumesAdminNegativeTest-106883733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5704822c-ed41-4c9b-bae8-1d90b586cce2 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6d14d484-c8c9-471a-a773-fe3f13c787e3 tempest-GroupsV320Test-541244149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6d14d484-c8c9-471a-a773-fe3f13c787e3 tempest-GroupsV320Test-541244149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6d14d484-c8c9-471a-a773-fe3f13c787e3 tempest-GroupsV320Test-541244149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:00:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6d14d484-c8c9-471a-a773-fe3f13c787e3 tempest-GroupsV320Test-541244149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:00:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6d14d484-c8c9-471a-a773-fe3f13c787e3 tempest-GroupsV320Test-541244149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6d14d484-c8c9-471a-a773-fe3f13c787e3 tempest-GroupsV320Test-541244149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:14 devstack sudo[89507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:00:14 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:14 devstack sudo[89506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5704822c-ed41-4c9b-bae8-1d90b586cce2
Jul 03 13:00:14 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:00:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:00:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:00:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:14 devstack sudo[89510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:00:14 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:16 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.159s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:16 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:00:16 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:00:16 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 8 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:00:16 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:00:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-ad9c86fc-b4b1-480d-aca3-305f4bc22ff0 req-eab0d227-633a-4a65-8a7d-dae880723ea3 tempest-ServerActionsTestOtherA-276524832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-ad9c86fc-b4b1-480d-aca3-305f4bc22ff0 req-eab0d227-633a-4a65-8a7d-dae880723ea3 tempest-ServerActionsTestOtherA-276524832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:16 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8bc890-17e3-4652-97e5-93a435780e83]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:00:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-ad9c86fc-b4b1-480d-aca3-305f4bc22ff0 req-eab0d227-633a-4a65-8a7d-dae880723ea3 tempest-ServerActionsTestOtherA-276524832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c1dbe101-260d-4756-9259-5bd1461cf077 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:16 devstack sudo[89523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c1dbe101-260d-4756-9259-5bd1461cf077
Jul 03 13:00:16 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:16 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8c1d635d-f1c4-4cf3-a1cb-5b4e2dfc7613 tempest-VolumesAdminNegativeTest-106883733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5704822c-ed41-4c9b-bae8-1d90b586cce2" returned: 0 in 2.111s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8c1d635d-f1c4-4cf3-a1cb-5b4e2dfc7613 tempest-VolumesAdminNegativeTest-106883733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5704822c-ed41-4c9b-bae8-1d90b586cce2 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:16 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:16 devstack sudo[89527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5704822c-ed41-4c9b-bae8-1d90b586cce2
Jul 03 13:00:16 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6d14d484-c8c9-471a-a773-fe3f13c787e3 tempest-GroupsV320Test-541244149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 2.056s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:16 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-6d14d484-c8c9-471a-a773-fe3f13c787e3 tempest-GroupsV320Test-541244149 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:00:16 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-6d14d484-c8c9-471a-a773-fe3f13c787e3 tempest-GroupsV320Test-541244149 None] Delete group completed successfully.
Jul 03 13:00:18 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8c1d635d-f1c4-4cf3-a1cb-5b4e2dfc7613 tempest-VolumesAdminNegativeTest-106883733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5704822c-ed41-4c9b-bae8-1d90b586cce2" returned: 0 in 1.490s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:18 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8c1d635d-f1c4-4cf3-a1cb-5b4e2dfc7613 tempest-VolumesAdminNegativeTest-106883733 None] Lock "cinder-quobyte-5704822c-ed41-4c9b-bae8-1d90b586cce2" released by "delete_volume" :: held 3.701s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:00:18 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-8c1d635d-f1c4-4cf3-a1cb-5b4e2dfc7613 tempest-VolumesAdminNegativeTest-106883733 None] Created reservations ['9a1f76dd-c609-4b33-9dd8-69a57450f373', '15461f14-c274-426d-b56e-9b1578469816', '71ed2736-d293-47c5-b0bc-db74373d9959', '8e9d22de-f319-4373-82a0-5817a26c76d8'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:00:18 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-ad9c86fc-b4b1-480d-aca3-305f4bc22ff0 req-eab0d227-633a-4a65-8a7d-dae880723ea3 tempest-ServerActionsTestOtherA-276524832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c1dbe101-260d-4756-9259-5bd1461cf077" returned: 0 in 2.104s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-ad9c86fc-b4b1-480d-aca3-305f4bc22ff0 req-eab0d227-633a-4a65-8a7d-dae880723ea3 tempest-ServerActionsTestOtherA-276524832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.145s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:18 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-ad9c86fc-b4b1-480d-aca3-305f4bc22ff0 req-eab0d227-633a-4a65-8a7d-dae880723ea3 tempest-ServerActionsTestOtherA-276524832 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db', 'name': 'volume-c1dbe101-260d-4756-9259-5bd1461cf077', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24279160-3376-4aa7-9b90-605e6ddba535', 'enforce_multipath': True} {{(pid=86837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 13:00:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8c1d635d-f1c4-4cf3-a1cb-5b4e2dfc7613 tempest-VolumesAdminNegativeTest-106883733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8c1d635d-f1c4-4cf3-a1cb-5b4e2dfc7613 tempest-VolumesAdminNegativeTest-106883733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:18 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8c1d635d-f1c4-4cf3-a1cb-5b4e2dfc7613 tempest-VolumesAdminNegativeTest-106883733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:00:18 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8c1d635d-f1c4-4cf3-a1cb-5b4e2dfc7613 tempest-VolumesAdminNegativeTest-106883733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:00:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8c1d635d-f1c4-4cf3-a1cb-5b4e2dfc7613 tempest-VolumesAdminNegativeTest-106883733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8c1d635d-f1c4-4cf3-a1cb-5b4e2dfc7613 tempest-VolumesAdminNegativeTest-106883733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:18 devstack sudo[89555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:00:18 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:18 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-ad9c86fc-b4b1-480d-aca3-305f4bc22ff0 req-eab0d227-633a-4a65-8a7d-dae880723ea3 tempest-ServerActionsTestOtherA-276524832 None] attachment_update completed successfully.
Jul 03 13:00:19 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8c1d635d-f1c4-4cf3-a1cb-5b4e2dfc7613 tempest-VolumesAdminNegativeTest-106883733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.029s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:19 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-8c1d635d-f1c4-4cf3-a1cb-5b4e2dfc7613 tempest-VolumesAdminNegativeTest-106883733 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:00:19 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-8c1d635d-f1c4-4cf3-a1cb-5b4e2dfc7613 tempest-VolumesAdminNegativeTest-106883733 None] Deleted volume successfully.
Jul 03 13:00:19 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8c1d635d-f1c4-4cf3-a1cb-5b4e2dfc7613 tempest-VolumesAdminNegativeTest-106883733 None] Lock "cinder-5704822c-ed41-4c9b-bae8-1d90b586cce2-delete_volume" released by "delete_volume" :: held 5.183s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:00:28 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:UPDATE=40,cinder:DELETE=1,cinder:SELECT=40,cinder:INSERT=8 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:00:29 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=54,cinder:INSERT=9,cinder:UPDATE=37,cinder:DELETE=2 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:00:44 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:00:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Flow 'volume_create_manager' (ccdd9f0a-e3a2-4bd7-9aca-ead621eca012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:00:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf25185b-2e26-4117-a23c-31c22052b27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf25185b-2e26-4117-a23c-31c22052b27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-334634759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5549316-2597-473b-aaf9-08ce694e11de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd26a061357a43e5bc0a902eb6a09805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:00:44Z,use_quota=True,user_id='a3e47137717e4d8c903aff9e09201a45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (850147e3-44b5-46cf-baed-3061d3a21c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (850147e3-44b5-46cf-baed-3061d3a21c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (462f704f-3ad9-4ec4-a7f2-38f0e2546958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (462f704f-3ad9-4ec4-a7f2-38f0e2546958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5549316-2597-473b-aaf9-08ce694e11de', 'volume_name': 'volume-d5549316-2597-473b-aaf9-08ce694e11de', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc3a860-1900-4f04-88a6-6c0dc0ba53a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc3a860-1900-4f04-88a6-6c0dc0ba53a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571f7678-1fa6-4416-9366-44cec073bd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:44 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Volume d5549316-2597-473b-aaf9-08ce694e11de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5549316-2597-473b-aaf9-08ce694e11de', 'volume_size': 1}
Jul 03 13:00:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-334634759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5549316-2597-473b-aaf9-08ce694e11de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd26a061357a43e5bc0a902eb6a09805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:00:44Z,use_quota=True,user_id='a3e47137717e4d8c903aff9e09201a45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:00:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Creating volume d5549316-2597-473b-aaf9-08ce694e11de {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:00:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:00:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:00:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:00:44 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:00:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d5549316-2597-473b-aaf9-08ce694e11de 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:44 devstack sudo[90207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d5549316-2597-473b-aaf9-08ce694e11de 1073741824
Jul 03 13:00:44 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:45 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d5549316-2597-473b-aaf9-08ce694e11de 1073741824" returned: 0 in 1.394s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d5549316-2597-473b-aaf9-08ce694e11de {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:45 devstack sudo[90214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d5549316-2597-473b-aaf9-08ce694e11de
Jul 03 13:00:45 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:47 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d5549316-2597-473b-aaf9-08ce694e11de" returned: 0 in 1.160s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:47 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] <== create_volume: return (2619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:00:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.623s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:47 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571f7678-1fa6-4416-9366-44cec073bd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5549316-2597-473b-aaf9-08ce694e11de', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:47 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89955396-5126-49fe-bbc9-97fb533506a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:47 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Volume volume-d5549316-2597-473b-aaf9-08ce694e11de (d5549316-2597-473b-aaf9-08ce694e11de): created successfully
Jul 03 13:00:47 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89955396-5126-49fe-bbc9-97fb533506a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:47 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Flow 'volume_create_manager' (ccdd9f0a-e3a2-4bd7-9aca-ead621eca012) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:00:47 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-a8e12029-1279-411f-aa37-c5190d1ef49e tempest-VolumeQuotasAdminTestJSON-1706771750 None] Created volume successfully.
Jul 03 13:00:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a310c42b-fdab-49b1-b52e-78572755a3d0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Acquiring lock "cinder-d5549316-2597-473b-aaf9-08ce694e11de-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:00:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a310c42b-fdab-49b1-b52e-78572755a3d0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Lock "cinder-d5549316-2597-473b-aaf9-08ce694e11de-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:00:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a310c42b-fdab-49b1-b52e-78572755a3d0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Acquiring lock "cinder-quobyte-d5549316-2597-473b-aaf9-08ce694e11de" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:00:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a310c42b-fdab-49b1-b52e-78572755a3d0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Lock "cinder-quobyte-d5549316-2597-473b-aaf9-08ce694e11de" acquired by "delete_volume" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:00:47 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[37254a2b-a883-4611-b363-43a59b384dd5]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:00:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a310c42b-fdab-49b1-b52e-78572755a3d0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d5549316-2597-473b-aaf9-08ce694e11de {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:47 devstack sudo[90220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d5549316-2597-473b-aaf9-08ce694e11de
Jul 03 13:00:47 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:49 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a310c42b-fdab-49b1-b52e-78572755a3d0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d5549316-2597-473b-aaf9-08ce694e11de" returned: 0 in 1.456s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a310c42b-fdab-49b1-b52e-78572755a3d0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d5549316-2597-473b-aaf9-08ce694e11de {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:49 devstack sudo[90226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d5549316-2597-473b-aaf9-08ce694e11de
Jul 03 13:00:49 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:50 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a310c42b-fdab-49b1-b52e-78572755a3d0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d5549316-2597-473b-aaf9-08ce694e11de" returned: 0 in 1.215s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a310c42b-fdab-49b1-b52e-78572755a3d0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Lock "cinder-quobyte-d5549316-2597-473b-aaf9-08ce694e11de" released by "delete_volume" :: held 2.729s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:00:50 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-a310c42b-fdab-49b1-b52e-78572755a3d0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Created reservations ['ade3aa6f-857c-4a87-9a2d-85ba01e11ef3', 'fc4bf4bb-27b7-4b93-bffb-cc42481b6620', '214a1cc5-c751-478c-a7a7-13e44cc1547c', 'b62db5bf-b036-4892-b419-40adc61cd3e3'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:00:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a310c42b-fdab-49b1-b52e-78572755a3d0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a310c42b-fdab-49b1-b52e-78572755a3d0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:50 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a310c42b-fdab-49b1-b52e-78572755a3d0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:00:50 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a310c42b-fdab-49b1-b52e-78572755a3d0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:00:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a310c42b-fdab-49b1-b52e-78572755a3d0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a310c42b-fdab-49b1-b52e-78572755a3d0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:50 devstack sudo[90234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:00:50 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:52 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:00:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Flow 'volume_create_manager' (c5716a9f-d86d-44ab-83d4-2d89f01aa58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:00:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc95f1c-d290-4d4d-8ccd-5b96b6b84ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc95f1c-d290-4d4d-8ccd-5b96b6b84ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-780227472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd9e8ac8-d9ca-4bae-b872-e5d1f9ac67a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd26a061357a43e5bc0a902eb6a09805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:00:52Z,use_quota=True,user_id='a3e47137717e4d8c903aff9e09201a45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad8066d-62f0-4323-9e55-d2da4d37d12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad8066d-62f0-4323-9e55-d2da4d37d12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ea6e1c-5117-4dca-be1b-adc650170f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ea6e1c-5117-4dca-be1b-adc650170f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd9e8ac8-d9ca-4bae-b872-e5d1f9ac67a8', 'volume_name': 'volume-dd9e8ac8-d9ca-4bae-b872-e5d1f9ac67a8', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe5efd4d-430c-4789-8863-70f926d51746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe5efd4d-430c-4789-8863-70f926d51746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d0ef861-ad55-4fcd-a888-765976ad5d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:52 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Volume dd9e8ac8-d9ca-4bae-b872-e5d1f9ac67a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd9e8ac8-d9ca-4bae-b872-e5d1f9ac67a8', 'volume_size': 1}
Jul 03 13:00:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-780227472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd9e8ac8-d9ca-4bae-b872-e5d1f9ac67a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd26a061357a43e5bc0a902eb6a09805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:00:52Z,use_quota=True,user_id='a3e47137717e4d8c903aff9e09201a45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:00:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Creating volume dd9e8ac8-d9ca-4bae-b872-e5d1f9ac67a8 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:00:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:00:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:00:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:00:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:00:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:00:52 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:00:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-dd9e8ac8-d9ca-4bae-b872-e5d1f9ac67a8 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:52 devstack sudo[90262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-dd9e8ac8-d9ca-4bae-b872-e5d1f9ac67a8 1073741824
Jul 03 13:00:52 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:52 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a310c42b-fdab-49b1-b52e-78572755a3d0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 2.221s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:52 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-a310c42b-fdab-49b1-b52e-78572755a3d0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:00:52 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-a310c42b-fdab-49b1-b52e-78572755a3d0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Deleted volume successfully.
Jul 03 13:00:52 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a310c42b-fdab-49b1-b52e-78572755a3d0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Lock "cinder-d5549316-2597-473b-aaf9-08ce694e11de-delete_volume" released by "delete_volume" :: held 5.325s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:00:53 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-1ec45d84-204b-4dc1-838a-84e18c0f03de req-37bbbecf-19bf-4c7f-b6f9-f8e0fb9604b6 tempest-ServerActionsTestOtherA-276524832 None] Terminate volume connection completed successfully.
Jul 03 13:00:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-1ec45d84-204b-4dc1-838a-84e18c0f03de req-37bbbecf-19bf-4c7f-b6f9-f8e0fb9604b6 tempest-ServerActionsTestOtherA-276524832 None] Deleting attachment 24279160-3376-4aa7-9b90-605e6ddba535. {{(pid=86837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:00:54 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-dd9e8ac8-d9ca-4bae-b872-e5d1f9ac67a8 1073741824" returned: 0 in 1.626s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-dd9e8ac8-d9ca-4bae-b872-e5d1f9ac67a8 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:54 devstack sudo[90271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-dd9e8ac8-d9ca-4bae-b872-e5d1f9ac67a8
Jul 03 13:00:54 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:55 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-dd9e8ac8-d9ca-4bae-b872-e5d1f9ac67a8" returned: 0 in 0.893s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:55 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] <== create_volume: return (2598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:00:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.602s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:00:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d0ef861-ad55-4fcd-a888-765976ad5d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd9e8ac8-d9ca-4bae-b872-e5d1f9ac67a8', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (925ead82-7fe7-45e3-8315-b781e02e1f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:00:55 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Volume volume-dd9e8ac8-d9ca-4bae-b872-e5d1f9ac67a8 (dd9e8ac8-d9ca-4bae-b872-e5d1f9ac67a8): created successfully
Jul 03 13:00:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (925ead82-7fe7-45e3-8315-b781e02e1f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:00:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Flow 'volume_create_manager' (c5716a9f-d86d-44ab-83d4-2d89f01aa58f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:00:55 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-466b982f-b56b-4f7c-94ff-51bcd4e0b8f0 tempest-VolumeQuotasAdminTestJSON-1706771750 None] Created volume successfully.
Jul 03 13:00:57 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-349d6a41-c03d-4f63-81a8-08b4c95fa06b tempest-VolumeQuotasAdminTestJSON-982801933 None] Transfer volume completed successfully.
Jul 03 13:00:58 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-aed5351b-5db3-47c5-b2a3-a73375f9cff0 tempest-VolumeQuotasAdminTestJSON-1653294801 None] Acquiring lock "cinder-dd9e8ac8-d9ca-4bae-b872-e5d1f9ac67a8-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:00:58 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-aed5351b-5db3-47c5-b2a3-a73375f9cff0 tempest-VolumeQuotasAdminTestJSON-1653294801 None] Lock "cinder-dd9e8ac8-d9ca-4bae-b872-e5d1f9ac67a8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:00:58 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-aed5351b-5db3-47c5-b2a3-a73375f9cff0 tempest-VolumeQuotasAdminTestJSON-1653294801 None] Acquiring lock "cinder-quobyte-dd9e8ac8-d9ca-4bae-b872-e5d1f9ac67a8" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:00:58 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-aed5351b-5db3-47c5-b2a3-a73375f9cff0 tempest-VolumeQuotasAdminTestJSON-1653294801 None] Lock "cinder-quobyte-dd9e8ac8-d9ca-4bae-b872-e5d1f9ac67a8" acquired by "delete_volume" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:00:58 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6874ac-58e1-40f5-9e9e-fff31cd9d678]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:00:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aed5351b-5db3-47c5-b2a3-a73375f9cff0 tempest-VolumeQuotasAdminTestJSON-1653294801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-dd9e8ac8-d9ca-4bae-b872-e5d1f9ac67a8 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:58 devstack sudo[90325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-dd9e8ac8-d9ca-4bae-b872-e5d1f9ac67a8
Jul 03 13:00:58 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:00:59 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root
Jul 03 13:00:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aed5351b-5db3-47c5-b2a3-a73375f9cff0 tempest-VolumeQuotasAdminTestJSON-1653294801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-dd9e8ac8-d9ca-4bae-b872-e5d1f9ac67a8" returned: 0 in 1.188s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:00:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aed5351b-5db3-47c5-b2a3-a73375f9cff0 tempest-VolumeQuotasAdminTestJSON-1653294801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-dd9e8ac8-d9ca-4bae-b872-e5d1f9ac67a8 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:00:59 devstack sudo[90335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-dd9e8ac8-d9ca-4bae-b872-e5d1f9ac67a8
Jul 03 13:00:59 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:00 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aed5351b-5db3-47c5-b2a3-a73375f9cff0 tempest-VolumeQuotasAdminTestJSON-1653294801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-dd9e8ac8-d9ca-4bae-b872-e5d1f9ac67a8" returned: 0 in 0.952s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:00 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-aed5351b-5db3-47c5-b2a3-a73375f9cff0 tempest-VolumeQuotasAdminTestJSON-1653294801 None] Lock "cinder-quobyte-dd9e8ac8-d9ca-4bae-b872-e5d1f9ac67a8" released by "delete_volume" :: held 2.205s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:01:00 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-aed5351b-5db3-47c5-b2a3-a73375f9cff0 tempest-VolumeQuotasAdminTestJSON-1653294801 None] Created reservations ['67c83ae5-dbac-4306-a325-bbd51ca58b4b', '158fc02f-154c-44f6-8c42-97d311980af9', '2b057a30-235e-4932-b2e0-dcabb90ea4c7', 'f45e12b3-d934-4fc9-8227-27cb3f4595ee'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:01:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aed5351b-5db3-47c5-b2a3-a73375f9cff0 tempest-VolumeQuotasAdminTestJSON-1653294801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aed5351b-5db3-47c5-b2a3-a73375f9cff0 tempest-VolumeQuotasAdminTestJSON-1653294801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aed5351b-5db3-47c5-b2a3-a73375f9cff0 tempest-VolumeQuotasAdminTestJSON-1653294801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:01:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aed5351b-5db3-47c5-b2a3-a73375f9cff0 tempest-VolumeQuotasAdminTestJSON-1653294801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:01:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aed5351b-5db3-47c5-b2a3-a73375f9cff0 tempest-VolumeQuotasAdminTestJSON-1653294801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aed5351b-5db3-47c5-b2a3-a73375f9cff0 tempest-VolumeQuotasAdminTestJSON-1653294801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:00 devstack sudo[90344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:01:00 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:01 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aed5351b-5db3-47c5-b2a3-a73375f9cff0 tempest-VolumeQuotasAdminTestJSON-1653294801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.959s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:01 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-aed5351b-5db3-47c5-b2a3-a73375f9cff0 tempest-VolumeQuotasAdminTestJSON-1653294801 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:01:01 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-aed5351b-5db3-47c5-b2a3-a73375f9cff0 tempest-VolumeQuotasAdminTestJSON-1653294801 None] Deleted volume successfully.
Jul 03 13:01:01 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-aed5351b-5db3-47c5-b2a3-a73375f9cff0 tempest-VolumeQuotasAdminTestJSON-1653294801 None] Lock "cinder-dd9e8ac8-d9ca-4bae-b872-e5d1f9ac67a8-delete_volume" released by "delete_volume" :: held 3.564s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:01:07 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:01:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Flow 'volume_create_manager' (26b02f70-b9ac-4197-92fc-66087350acc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:01:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217dad69-2021-4c77-8a05-6012f21a93af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217dad69-2021-4c77-8a05-6012f21a93af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-306805529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c464ef63-bb66-4b19-a7a1-f28edac5d68e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf3e348595f4449b4471a07efb2c8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:08Z,use_quota=True,user_id='080ff63f2eb047eabf4e1642faa7ff98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a8848c-1e8f-4f9a-b101-e3deeedb2b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a8848c-1e8f-4f9a-b101-e3deeedb2b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd241743-d07d-4d11-912e-66e55d48e794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd241743-d07d-4d11-912e-66e55d48e794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c464ef63-bb66-4b19-a7a1-f28edac5d68e', 'volume_name': 'volume-c464ef63-bb66-4b19-a7a1-f28edac5d68e', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c48710-2e93-4bf6-ad2c-08f1fe2ef09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c48710-2e93-4bf6-ad2c-08f1fe2ef09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748174db-a229-4177-9fe5-e809eac6f39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:07 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Volume c464ef63-bb66-4b19-a7a1-f28edac5d68e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c464ef63-bb66-4b19-a7a1-f28edac5d68e', 'volume_size': 1}
Jul 03 13:01:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:07 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-306805529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c464ef63-bb66-4b19-a7a1-f28edac5d68e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf3e348595f4449b4471a07efb2c8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:08Z,use_quota=True,user_id='080ff63f2eb047eabf4e1642faa7ff98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:01:07 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Creating volume c464ef63-bb66-4b19-a7a1-f28edac5d68e {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:01:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:07 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:01:07 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:01:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:07 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:01:07 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:01:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c464ef63-bb66-4b19-a7a1-f28edac5d68e 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:08 devstack sudo[90387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c464ef63-bb66-4b19-a7a1-f28edac5d68e 1073741824
Jul 03 13:01:08 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-aeca5111-1988-4a70-847d-3c90526a31cd tempest-ServerActionsTestOtherA-276524832 None] Acquiring lock "cinder-c1dbe101-260d-4756-9259-5bd1461cf077-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:01:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-aeca5111-1988-4a70-847d-3c90526a31cd tempest-ServerActionsTestOtherA-276524832 None] Lock "cinder-c1dbe101-260d-4756-9259-5bd1461cf077-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:01:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-aeca5111-1988-4a70-847d-3c90526a31cd tempest-ServerActionsTestOtherA-276524832 None] Acquiring lock "cinder-quobyte-c1dbe101-260d-4756-9259-5bd1461cf077" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:01:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-aeca5111-1988-4a70-847d-3c90526a31cd tempest-ServerActionsTestOtherA-276524832 None] Lock "cinder-quobyte-c1dbe101-260d-4756-9259-5bd1461cf077" acquired by "delete_volume" :: waited 0.037s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:01:08 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02217a3-0485-4b4b-b68c-b1b0848c4385]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:01:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aeca5111-1988-4a70-847d-3c90526a31cd tempest-ServerActionsTestOtherA-276524832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c1dbe101-260d-4756-9259-5bd1461cf077 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:09 devstack sudo[90392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c1dbe101-260d-4756-9259-5bd1461cf077
Jul 03 13:01:09 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:09 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c464ef63-bb66-4b19-a7a1-f28edac5d68e 1073741824" returned: 0 in 1.402s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c464ef63-bb66-4b19-a7a1-f28edac5d68e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:09 devstack sudo[90395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c464ef63-bb66-4b19-a7a1-f28edac5d68e
Jul 03 13:01:09 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:10 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aeca5111-1988-4a70-847d-3c90526a31cd tempest-ServerActionsTestOtherA-276524832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c1dbe101-260d-4756-9259-5bd1461cf077" returned: 0 in 1.303s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aeca5111-1988-4a70-847d-3c90526a31cd tempest-ServerActionsTestOtherA-276524832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c1dbe101-260d-4756-9259-5bd1461cf077 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:10 devstack sudo[90401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c1dbe101-260d-4756-9259-5bd1461cf077
Jul 03 13:01:10 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:10 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c464ef63-bb66-4b19-a7a1-f28edac5d68e" returned: 0 in 1.017s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:10 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] <== create_volume: return (2492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:01:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.496s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:10 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748174db-a229-4177-9fe5-e809eac6f39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c464ef63-bb66-4b19-a7a1-f28edac5d68e', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:10 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a990cc-73b8-4415-a5f4-fc1b2c16e750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:10 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Volume volume-c464ef63-bb66-4b19-a7a1-f28edac5d68e (c464ef63-bb66-4b19-a7a1-f28edac5d68e): created successfully
Jul 03 13:01:10 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a990cc-73b8-4415-a5f4-fc1b2c16e750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:10 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Flow 'volume_create_manager' (26b02f70-b9ac-4197-92fc-66087350acc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:01:10 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-90e79212-7c2d-4a1e-8166-d65bcb600f35 tempest-AttachVolumeShelveTestJSON-2004640808 None] Created volume successfully.
Jul 03 13:01:11 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aeca5111-1988-4a70-847d-3c90526a31cd tempest-ServerActionsTestOtherA-276524832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c1dbe101-260d-4756-9259-5bd1461cf077" returned: 0 in 1.159s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:11 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-aeca5111-1988-4a70-847d-3c90526a31cd tempest-ServerActionsTestOtherA-276524832 None] Lock "cinder-quobyte-c1dbe101-260d-4756-9259-5bd1461cf077" released by "delete_volume" :: held 2.563s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:01:11 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-aeca5111-1988-4a70-847d-3c90526a31cd tempest-ServerActionsTestOtherA-276524832 None] Created reservations ['eb0a57a4-278d-4d99-9ae0-7424e8fdc6b2', 'ff48a017-bae1-41ca-b62b-1289a0ca5d95', 'c8bdfad6-bc61-43e2-9419-e57251d9e2ee', '0b0d4c70-5906-42e4-adf4-43400bd7f98c'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:01:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aeca5111-1988-4a70-847d-3c90526a31cd tempest-ServerActionsTestOtherA-276524832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aeca5111-1988-4a70-847d-3c90526a31cd tempest-ServerActionsTestOtherA-276524832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aeca5111-1988-4a70-847d-3c90526a31cd tempest-ServerActionsTestOtherA-276524832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:01:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aeca5111-1988-4a70-847d-3c90526a31cd tempest-ServerActionsTestOtherA-276524832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:01:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aeca5111-1988-4a70-847d-3c90526a31cd tempest-ServerActionsTestOtherA-276524832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aeca5111-1988-4a70-847d-3c90526a31cd tempest-ServerActionsTestOtherA-276524832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:11 devstack sudo[90408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:01:11 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:13 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aeca5111-1988-4a70-847d-3c90526a31cd tempest-ServerActionsTestOtherA-276524832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.238s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:13 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-aeca5111-1988-4a70-847d-3c90526a31cd tempest-ServerActionsTestOtherA-276524832 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:01:13 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-aeca5111-1988-4a70-847d-3c90526a31cd tempest-ServerActionsTestOtherA-276524832 None] Deleted volume successfully.
Jul 03 13:01:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-aeca5111-1988-4a70-847d-3c90526a31cd tempest-ServerActionsTestOtherA-276524832 None] Lock "cinder-c1dbe101-260d-4756-9259-5bd1461cf077-delete_volume" released by "delete_volume" :: held 4.305s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:01:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:01:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:01:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:01:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:14 devstack sudo[90451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:01:14 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:16 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.246s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:16 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:01:16 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:01:16 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 8 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:01:16 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:01:21 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=21,cinder:INSERT=6,cinder:UPDATE=32,cinder:DELETE=2 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:01:23 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:UPDATE=35,cinder:SELECT=25,cinder:DELETE=4,cinder:INSERT=9 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:01:35 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:01:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Flow 'volume_create_manager' (c3db741c-b782-4773-8cfd-73f6c656d0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:01:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df7972e7-5de7-4428-b507-859af2c9fc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df7972e7-5de7-4428-b507-859af2c9fc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1579944521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b3a725c-6a94-451d-82ef-d63bb7cca05e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50f46dfcde74219b558348d247d37e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:35Z,use_quota=True,user_id='af63e7f09df9482c96e36fa1f4a766d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2a57bc-15ac-483c-8c5a-fe3983661eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2a57bc-15ac-483c-8c5a-fe3983661eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5db238bd-df6e-42fa-b10c-da178b481f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5db238bd-df6e-42fa-b10c-da178b481f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b3a725c-6a94-451d-82ef-d63bb7cca05e', 'volume_name': 'volume-9b3a725c-6a94-451d-82ef-d63bb7cca05e', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85da41b-0ca1-4ce2-9b28-7956ce06ed45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85da41b-0ca1-4ce2-9b28-7956ce06ed45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf65a2e9-9976-4d90-b3c7-ba9228c627a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:35 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Volume 9b3a725c-6a94-451d-82ef-d63bb7cca05e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b3a725c-6a94-451d-82ef-d63bb7cca05e', 'volume_size': 1}
Jul 03 13:01:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1579944521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b3a725c-6a94-451d-82ef-d63bb7cca05e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50f46dfcde74219b558348d247d37e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:35Z,use_quota=True,user_id='af63e7f09df9482c96e36fa1f4a766d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:01:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Creating volume 9b3a725c-6a94-451d-82ef-d63bb7cca05e {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:01:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:01:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:01:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:01:35 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:01:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9b3a725c-6a94-451d-82ef-d63bb7cca05e 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:35 devstack sudo[90517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9b3a725c-6a94-451d-82ef-d63bb7cca05e 1073741824
Jul 03 13:01:35 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:36 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9b3a725c-6a94-451d-82ef-d63bb7cca05e 1073741824" returned: 0 in 1.302s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9b3a725c-6a94-451d-82ef-d63bb7cca05e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:36 devstack sudo[90523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9b3a725c-6a94-451d-82ef-d63bb7cca05e
Jul 03 13:01:36 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:37 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9b3a725c-6a94-451d-82ef-d63bb7cca05e" returned: 0 in 0.870s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] <== create_volume: return (2296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:01:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.300s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf65a2e9-9976-4d90-b3c7-ba9228c627a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b3a725c-6a94-451d-82ef-d63bb7cca05e', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec8f8e35-e110-473c-8cbd-1938646eceda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:37 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Volume volume-9b3a725c-6a94-451d-82ef-d63bb7cca05e (9b3a725c-6a94-451d-82ef-d63bb7cca05e): created successfully
Jul 03 13:01:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec8f8e35-e110-473c-8cbd-1938646eceda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Flow 'volume_create_manager' (c3db741c-b782-4773-8cfd-73f6c656d0d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:01:37 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-e3c12c0f-c620-4b55-a09b-d7004ff382d2 tempest-AbsoluteLimitsTests-619709485 None] Created volume successfully.
Jul 03 13:01:38 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-772fd976-397a-4fe0-8a61-a36f465434e0 tempest-AbsoluteLimitsTests-619709485 None] Acquiring lock "cinder-9b3a725c-6a94-451d-82ef-d63bb7cca05e-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:01:38 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-772fd976-397a-4fe0-8a61-a36f465434e0 tempest-AbsoluteLimitsTests-619709485 None] Lock "cinder-9b3a725c-6a94-451d-82ef-d63bb7cca05e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:01:38 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-772fd976-397a-4fe0-8a61-a36f465434e0 tempest-AbsoluteLimitsTests-619709485 None] Acquiring lock "cinder-quobyte-9b3a725c-6a94-451d-82ef-d63bb7cca05e" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:01:38 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-772fd976-397a-4fe0-8a61-a36f465434e0 tempest-AbsoluteLimitsTests-619709485 None] Lock "cinder-quobyte-9b3a725c-6a94-451d-82ef-d63bb7cca05e" acquired by "delete_volume" :: waited 0.036s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:01:38 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[773a9739-002a-4b24-971c-d9628ae43630]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:01:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-772fd976-397a-4fe0-8a61-a36f465434e0 tempest-AbsoluteLimitsTests-619709485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9b3a725c-6a94-451d-82ef-d63bb7cca05e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:39 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:01:39 devstack sudo[90526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9b3a725c-6a94-451d-82ef-d63bb7cca05e
Jul 03 13:01:39 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Flow 'volume_create_manager' (2e343cfe-d4a8-4643-92d3-02bf6c0f5ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:01:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b48625b0-3e3e-43ae-9f3e-f099b680571e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b48625b0-3e3e-43ae-9f3e-f099b680571e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1625353979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f58936-d9ba-46ca-9779-bbcd5ac108a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ba41adaff3c4ddbb12cb3f9758706c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:39Z,use_quota=True,user_id='96e509f22f46438485445a2ac88a9110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89a61298-fa33-44ea-832a-a7e632aa77c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89a61298-fa33-44ea-832a-a7e632aa77c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2585a612-c67b-4fea-843f-4a5866abeead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2585a612-c67b-4fea-843f-4a5866abeead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6f58936-d9ba-46ca-9779-bbcd5ac108a4', 'volume_name': 'volume-a6f58936-d9ba-46ca-9779-bbcd5ac108a4', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8781690f-9d81-4e93-8fb5-bdd8460890bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8781690f-9d81-4e93-8fb5-bdd8460890bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60744e26-0d29-4346-924a-9f7901bceb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:39 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Volume a6f58936-d9ba-46ca-9779-bbcd5ac108a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6f58936-d9ba-46ca-9779-bbcd5ac108a4', 'volume_size': 1}
Jul 03 13:01:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1625353979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f58936-d9ba-46ca-9779-bbcd5ac108a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ba41adaff3c4ddbb12cb3f9758706c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:39Z,use_quota=True,user_id='96e509f22f46438485445a2ac88a9110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:01:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Creating volume a6f58936-d9ba-46ca-9779-bbcd5ac108a4 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:01:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:01:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:01:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:01:39 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:01:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a6f58936-d9ba-46ca-9779-bbcd5ac108a4 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:39 devstack sudo[90529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a6f58936-d9ba-46ca-9779-bbcd5ac108a4 1073741824
Jul 03 13:01:39 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-f9808a43-7043-4f44-ae48-0d5b287cffda req-5f90b20a-9fb9-4ec0-93ed-a4c30545978d tempest-AttachVolumeShelveTestJSON-2004640808 None] No connector for attachment 1758ec5a-fe02-4c77-ad8b-79b8018a369e; skipping storage backend terminate_connection call. {{(pid=86837) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jul 03 13:01:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-f9808a43-7043-4f44-ae48-0d5b287cffda req-5f90b20a-9fb9-4ec0-93ed-a4c30545978d tempest-AttachVolumeShelveTestJSON-2004640808 None] Deleting attachment 1758ec5a-fe02-4c77-ad8b-79b8018a369e. {{(pid=86837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:01:39 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-772fd976-397a-4fe0-8a61-a36f465434e0 tempest-AbsoluteLimitsTests-619709485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9b3a725c-6a94-451d-82ef-d63bb7cca05e" returned: 0 in 1.046s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-772fd976-397a-4fe0-8a61-a36f465434e0 tempest-AbsoluteLimitsTests-619709485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9b3a725c-6a94-451d-82ef-d63bb7cca05e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:40 devstack sudo[90537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9b3a725c-6a94-451d-82ef-d63bb7cca05e
Jul 03 13:01:40 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:40 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a6f58936-d9ba-46ca-9779-bbcd5ac108a4 1073741824" returned: 0 in 1.098s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a6f58936-d9ba-46ca-9779-bbcd5ac108a4 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:40 devstack sudo[90540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a6f58936-d9ba-46ca-9779-bbcd5ac108a4
Jul 03 13:01:40 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:41 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-772fd976-397a-4fe0-8a61-a36f465434e0 tempest-AbsoluteLimitsTests-619709485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9b3a725c-6a94-451d-82ef-d63bb7cca05e" returned: 0 in 1.110s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:41 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-772fd976-397a-4fe0-8a61-a36f465434e0 tempest-AbsoluteLimitsTests-619709485 None] Lock "cinder-quobyte-9b3a725c-6a94-451d-82ef-d63bb7cca05e" released by "delete_volume" :: held 2.235s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:01:41 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-772fd976-397a-4fe0-8a61-a36f465434e0 tempest-AbsoluteLimitsTests-619709485 None] Created reservations ['9f91bd8e-354e-4c5b-a306-bc947932a707', '6b2c310b-b5f0-4443-85e6-d93f849109ff', '169ab41e-886c-4b0a-a71f-dc9e976c3724', 'bd215479-80b8-426d-9e9f-be3d18bf9e7c'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:01:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-772fd976-397a-4fe0-8a61-a36f465434e0 tempest-AbsoluteLimitsTests-619709485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-772fd976-397a-4fe0-8a61-a36f465434e0 tempest-AbsoluteLimitsTests-619709485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-772fd976-397a-4fe0-8a61-a36f465434e0 tempest-AbsoluteLimitsTests-619709485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:01:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-772fd976-397a-4fe0-8a61-a36f465434e0 tempest-AbsoluteLimitsTests-619709485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:01:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-772fd976-397a-4fe0-8a61-a36f465434e0 tempest-AbsoluteLimitsTests-619709485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-772fd976-397a-4fe0-8a61-a36f465434e0 tempest-AbsoluteLimitsTests-619709485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:41 devstack sudo[90545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:01:41 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:41 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a6f58936-d9ba-46ca-9779-bbcd5ac108a4" returned: 0 in 1.073s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] <== create_volume: return (2255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:01:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.262s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60744e26-0d29-4346-924a-9f7901bceb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6f58936-d9ba-46ca-9779-bbcd5ac108a4', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847febf6-6499-4581-8b5d-9723338d2978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:41 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Volume volume-a6f58936-d9ba-46ca-9779-bbcd5ac108a4 (a6f58936-d9ba-46ca-9779-bbcd5ac108a4): created successfully
Jul 03 13:01:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847febf6-6499-4581-8b5d-9723338d2978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Flow 'volume_create_manager' (2e343cfe-d4a8-4643-92d3-02bf6c0f5ad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:01:41 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-19d0e256-b0e0-420f-8413-511e3a9e8015 tempest-TaggedAttachmentsTest-1486521284 None] Created volume successfully.
Jul 03 13:01:42 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-772fd976-397a-4fe0-8a61-a36f465434e0 tempest-AbsoluteLimitsTests-619709485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.076s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:42 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-772fd976-397a-4fe0-8a61-a36f465434e0 tempest-AbsoluteLimitsTests-619709485 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:01:42 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-772fd976-397a-4fe0-8a61-a36f465434e0 tempest-AbsoluteLimitsTests-619709485 None] Deleted volume successfully.
Jul 03 13:01:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-772fd976-397a-4fe0-8a61-a36f465434e0 tempest-AbsoluteLimitsTests-619709485 None] Lock "cinder-9b3a725c-6a94-451d-82ef-d63bb7cca05e-delete_volume" released by "delete_volume" :: held 3.767s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:01:51 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:UPDATE=18,cinder:SELECT=12,cinder:DELETE=2,cinder:INSERT=3 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:01:52 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=8,cinder:INSERT=3,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:01:57 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:01:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Flow 'volume_create_manager' (2fffa93c-344f-45c0-be35-3f97de4f9272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:01:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c0f828-fc1d-4bfc-9c10-cc4fe50b1eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c0f828-fc1d-4bfc-9c10-cc4fe50b1eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-853171886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbf99d96-04ca-4fa7-8a16-8478894a4760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c728bba2134d6ea064f55cde920fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:57Z,use_quota=True,user_id='edf15c16d40a47758d7d2a2689ac754a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db486b5-42ca-47b8-b80d-ac0409cf905e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db486b5-42ca-47b8-b80d-ac0409cf905e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf2477c-84c1-4f46-acf4-cb74b63ee7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf2477c-84c1-4f46-acf4-cb74b63ee7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbf99d96-04ca-4fa7-8a16-8478894a4760', 'volume_name': 'volume-fbf99d96-04ca-4fa7-8a16-8478894a4760', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b893f091-e9f7-4cf5-9004-9a91413af09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b893f091-e9f7-4cf5-9004-9a91413af09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:01:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee5dbf4-45d8-4727-bc34-4a73e7aeb927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:01:57 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Volume fbf99d96-04ca-4fa7-8a16-8478894a4760: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbf99d96-04ca-4fa7-8a16-8478894a4760', 'volume_size': 1}
Jul 03 13:01:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-853171886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbf99d96-04ca-4fa7-8a16-8478894a4760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c728bba2134d6ea064f55cde920fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:01:57Z,use_quota=True,user_id='edf15c16d40a47758d7d2a2689ac754a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:01:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Creating volume fbf99d96-04ca-4fa7-8a16-8478894a4760 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:01:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:01:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:01:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:01:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:01:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:01:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:01:57 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:01:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fbf99d96-04ca-4fa7-8a16-8478894a4760 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:57 devstack sudo[90579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fbf99d96-04ca-4fa7-8a16-8478894a4760 1073741824
Jul 03 13:01:57 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:01:58 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root
Jul 03 13:01:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fbf99d96-04ca-4fa7-8a16-8478894a4760 1073741824" returned: 0 in 1.375s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:01:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fbf99d96-04ca-4fa7-8a16-8478894a4760 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:01:58 devstack sudo[90609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fbf99d96-04ca-4fa7-8a16-8478894a4760
Jul 03 13:01:58 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:00 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fbf99d96-04ca-4fa7-8a16-8478894a4760" returned: 0 in 1.345s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] <== create_volume: return (2844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:02:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.852s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee5dbf4-45d8-4727-bc34-4a73e7aeb927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbf99d96-04ca-4fa7-8a16-8478894a4760', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e3be52f-234e-4256-98df-8d0efcfb0b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:00 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Volume volume-fbf99d96-04ca-4fa7-8a16-8478894a4760 (fbf99d96-04ca-4fa7-8a16-8478894a4760): created successfully
Jul 03 13:02:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e3be52f-234e-4256-98df-8d0efcfb0b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Flow 'volume_create_manager' (2fffa93c-344f-45c0-be35-3f97de4f9272) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:02:00 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-25b390b4-b396-432f-b59c-55f91c10f66f tempest-VolumesTransfersV355Test-676546098 None] Created volume successfully.
Jul 03 13:02:01 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-7bed8a3f-9818-4a7c-bf33-56b2c27ae66d tempest-VolumesTransfersV355Test-1555620307 None] Transfer volume completed successfully.
Jul 03 13:02:03 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cd7bfcee-54a6-445a-bfe9-acfc9a29cb3c tempest-VolumesTransfersV355Test-1128794915 None] Acquiring lock "cinder-fbf99d96-04ca-4fa7-8a16-8478894a4760-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:03 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cd7bfcee-54a6-445a-bfe9-acfc9a29cb3c tempest-VolumesTransfersV355Test-1128794915 None] Lock "cinder-fbf99d96-04ca-4fa7-8a16-8478894a4760-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:03 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cd7bfcee-54a6-445a-bfe9-acfc9a29cb3c tempest-VolumesTransfersV355Test-1128794915 None] Acquiring lock "cinder-quobyte-fbf99d96-04ca-4fa7-8a16-8478894a4760" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:03 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cd7bfcee-54a6-445a-bfe9-acfc9a29cb3c tempest-VolumesTransfersV355Test-1128794915 None] Lock "cinder-quobyte-fbf99d96-04ca-4fa7-8a16-8478894a4760" acquired by "delete_volume" :: waited 0.027s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:03 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f64c806-c09d-45a4-8d80-85ec0045abda]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cd7bfcee-54a6-445a-bfe9-acfc9a29cb3c tempest-VolumesTransfersV355Test-1128794915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fbf99d96-04ca-4fa7-8a16-8478894a4760 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:03 devstack sudo[90640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fbf99d96-04ca-4fa7-8a16-8478894a4760
Jul 03 13:02:03 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:04 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cd7bfcee-54a6-445a-bfe9-acfc9a29cb3c tempest-VolumesTransfersV355Test-1128794915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fbf99d96-04ca-4fa7-8a16-8478894a4760" returned: 0 in 1.043s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cd7bfcee-54a6-445a-bfe9-acfc9a29cb3c tempest-VolumesTransfersV355Test-1128794915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fbf99d96-04ca-4fa7-8a16-8478894a4760 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:04 devstack sudo[90645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fbf99d96-04ca-4fa7-8a16-8478894a4760
Jul 03 13:02:04 devstack sudo[90645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cd7bfcee-54a6-445a-bfe9-acfc9a29cb3c tempest-VolumesTransfersV355Test-1128794915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fbf99d96-04ca-4fa7-8a16-8478894a4760" returned: 0 in 1.502s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:05 devstack sudo[90645]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:05 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cd7bfcee-54a6-445a-bfe9-acfc9a29cb3c tempest-VolumesTransfersV355Test-1128794915 None] Lock "cinder-quobyte-fbf99d96-04ca-4fa7-8a16-8478894a4760" released by "delete_volume" :: held 2.625s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:05 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-cd7bfcee-54a6-445a-bfe9-acfc9a29cb3c tempest-VolumesTransfersV355Test-1128794915 None] Created reservations ['5210aa06-60fe-4808-bdf6-5a5d648d13ac', 'b771668d-977f-4535-842b-a315b721e25e', '5b6ff1f6-9005-4915-8417-04b1fc0f67b6', 'aa7800df-fcd1-4e86-8c82-333a32cda13a'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:02:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cd7bfcee-54a6-445a-bfe9-acfc9a29cb3c tempest-VolumesTransfersV355Test-1128794915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cd7bfcee-54a6-445a-bfe9-acfc9a29cb3c tempest-VolumesTransfersV355Test-1128794915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-cd7bfcee-54a6-445a-bfe9-acfc9a29cb3c tempest-VolumesTransfersV355Test-1128794915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-cd7bfcee-54a6-445a-bfe9-acfc9a29cb3c tempest-VolumesTransfersV355Test-1128794915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cd7bfcee-54a6-445a-bfe9-acfc9a29cb3c tempest-VolumesTransfersV355Test-1128794915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cd7bfcee-54a6-445a-bfe9-acfc9a29cb3c tempest-VolumesTransfersV355Test-1128794915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:06 devstack sudo[90734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:02:06 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:07 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cd7bfcee-54a6-445a-bfe9-acfc9a29cb3c tempest-VolumesTransfersV355Test-1128794915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.665s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:07 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-cd7bfcee-54a6-445a-bfe9-acfc9a29cb3c tempest-VolumesTransfersV355Test-1128794915 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:02:07 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-cd7bfcee-54a6-445a-bfe9-acfc9a29cb3c tempest-VolumesTransfersV355Test-1128794915 None] Deleted volume successfully.
Jul 03 13:02:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cd7bfcee-54a6-445a-bfe9-acfc9a29cb3c tempest-VolumesTransfersV355Test-1128794915 None] Lock "cinder-fbf99d96-04ca-4fa7-8a16-8478894a4760-delete_volume" released by "delete_volume" :: held 4.889s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:08 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:02:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Flow 'volume_create_manager' (00208f5b-8c7e-4325-8709-976e41d8a9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:02:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9162768b-09eb-4d58-9897-b8f3ca315152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9162768b-09eb-4d58-9897-b8f3ca315152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-44158257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea7ed410-8061-4b1d-a40d-9c26624cafa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c728bba2134d6ea064f55cde920fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:02:09Z,use_quota=True,user_id='edf15c16d40a47758d7d2a2689ac754a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1673b1a-5fa5-4092-bbc8-41ce3df3fbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1673b1a-5fa5-4092-bbc8-41ce3df3fbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95d7b7e-d194-4883-a2b5-77f6ddb070f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95d7b7e-d194-4883-a2b5-77f6ddb070f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea7ed410-8061-4b1d-a40d-9c26624cafa3', 'volume_name': 'volume-ea7ed410-8061-4b1d-a40d-9c26624cafa3', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6cc8e67-783e-40ea-88a3-663b3b4f80fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6cc8e67-783e-40ea-88a3-663b3b4f80fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82df3c59-e3e1-4fc2-933f-39574c659885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:08 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Volume ea7ed410-8061-4b1d-a40d-9c26624cafa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea7ed410-8061-4b1d-a40d-9c26624cafa3', 'volume_size': 1}
Jul 03 13:02:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-44158257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea7ed410-8061-4b1d-a40d-9c26624cafa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c728bba2134d6ea064f55cde920fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:02:09Z,use_quota=True,user_id='edf15c16d40a47758d7d2a2689ac754a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:02:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Creating volume ea7ed410-8061-4b1d-a40d-9c26624cafa3 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:02:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:02:08 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:02:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ea7ed410-8061-4b1d-a40d-9c26624cafa3 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:08 devstack sudo[90780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ea7ed410-8061-4b1d-a40d-9c26624cafa3 1073741824
Jul 03 13:02:08 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:10 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ea7ed410-8061-4b1d-a40d-9c26624cafa3 1073741824" returned: 0 in 1.242s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ea7ed410-8061-4b1d-a40d-9c26624cafa3 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:10 devstack sudo[90791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ea7ed410-8061-4b1d-a40d-9c26624cafa3
Jul 03 13:02:10 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:11 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ea7ed410-8061-4b1d-a40d-9c26624cafa3" returned: 0 in 0.848s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] <== create_volume: return (2153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:02:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.157s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82df3c59-e3e1-4fc2-933f-39574c659885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea7ed410-8061-4b1d-a40d-9c26624cafa3', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a1abf2-816f-48db-9377-423e7342112f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:11 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Volume volume-ea7ed410-8061-4b1d-a40d-9c26624cafa3 (ea7ed410-8061-4b1d-a40d-9c26624cafa3): created successfully
Jul 03 13:02:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a1abf2-816f-48db-9377-423e7342112f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Flow 'volume_create_manager' (00208f5b-8c7e-4325-8709-976e41d8a9f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:02:11 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-daf4b590-735c-4aaa-a0c4-201db385f177 tempest-VolumesTransfersV355Test-676546098 None] Created volume successfully.
Jul 03 13:02:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b84a30b3-cb98-45e1-9262-70721c2a0d67 tempest-VolumesTransfersV355Test-1128794915 None] Acquiring lock "cinder-ea7ed410-8061-4b1d-a40d-9c26624cafa3-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b84a30b3-cb98-45e1-9262-70721c2a0d67 tempest-VolumesTransfersV355Test-1128794915 None] Lock "cinder-ea7ed410-8061-4b1d-a40d-9c26624cafa3-delete_volume" acquired by "delete_volume" :: waited 0.154s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b84a30b3-cb98-45e1-9262-70721c2a0d67 tempest-VolumesTransfersV355Test-1128794915 None] Acquiring lock "cinder-quobyte-ea7ed410-8061-4b1d-a40d-9c26624cafa3" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b84a30b3-cb98-45e1-9262-70721c2a0d67 tempest-VolumesTransfersV355Test-1128794915 None] Lock "cinder-quobyte-ea7ed410-8061-4b1d-a40d-9c26624cafa3" acquired by "delete_volume" :: waited 0.062s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:13 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8aa3d8e-fdda-49e7-b84d-e8e228f8703a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b84a30b3-cb98-45e1-9262-70721c2a0d67 tempest-VolumesTransfersV355Test-1128794915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ea7ed410-8061-4b1d-a40d-9c26624cafa3 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:13 devstack sudo[90903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ea7ed410-8061-4b1d-a40d-9c26624cafa3
Jul 03 13:02:13 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:02:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:15 devstack sudo[90933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:02:15 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:16 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b84a30b3-cb98-45e1-9262-70721c2a0d67 tempest-VolumesTransfersV355Test-1128794915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ea7ed410-8061-4b1d-a40d-9c26624cafa3" returned: 0 in 2.891s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b84a30b3-cb98-45e1-9262-70721c2a0d67 tempest-VolumesTransfersV355Test-1128794915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ea7ed410-8061-4b1d-a40d-9c26624cafa3 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:16 devstack sudo[90946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ea7ed410-8061-4b1d-a40d-9c26624cafa3
Jul 03 13:02:16 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:16 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 2.021s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:17 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:02:17 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:02:17 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 8 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:02:17 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:02:18 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b84a30b3-cb98-45e1-9262-70721c2a0d67 tempest-VolumesTransfersV355Test-1128794915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ea7ed410-8061-4b1d-a40d-9c26624cafa3" returned: 0 in 2.151s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:18 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b84a30b3-cb98-45e1-9262-70721c2a0d67 tempest-VolumesTransfersV355Test-1128794915 None] Lock "cinder-quobyte-ea7ed410-8061-4b1d-a40d-9c26624cafa3" released by "delete_volume" :: held 5.239s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:18 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-b84a30b3-cb98-45e1-9262-70721c2a0d67 tempest-VolumesTransfersV355Test-1128794915 None] Created reservations ['6b879c81-a02c-4ce9-a0a4-9edd165ff23e', '97355fd9-7f88-472b-8449-3120d1b55a0b', 'ab3dc329-ccbc-4283-a0dd-c8615322ca1f', 'bc8dfcb7-68f8-4390-8d4c-2a75860cda1c'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:02:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b84a30b3-cb98-45e1-9262-70721c2a0d67 tempest-VolumesTransfersV355Test-1128794915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b84a30b3-cb98-45e1-9262-70721c2a0d67 tempest-VolumesTransfersV355Test-1128794915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:18 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b84a30b3-cb98-45e1-9262-70721c2a0d67 tempest-VolumesTransfersV355Test-1128794915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:18 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b84a30b3-cb98-45e1-9262-70721c2a0d67 tempest-VolumesTransfersV355Test-1128794915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b84a30b3-cb98-45e1-9262-70721c2a0d67 tempest-VolumesTransfersV355Test-1128794915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b84a30b3-cb98-45e1-9262-70721c2a0d67 tempest-VolumesTransfersV355Test-1128794915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:18 devstack sudo[90959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:02:18 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:21 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b84a30b3-cb98-45e1-9262-70721c2a0d67 tempest-VolumesTransfersV355Test-1128794915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 2.360s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:21 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-b84a30b3-cb98-45e1-9262-70721c2a0d67 tempest-VolumesTransfersV355Test-1128794915 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:02:21 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-b84a30b3-cb98-45e1-9262-70721c2a0d67 tempest-VolumesTransfersV355Test-1128794915 None] Deleted volume successfully.
Jul 03 13:02:21 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b84a30b3-cb98-45e1-9262-70721c2a0d67 tempest-VolumesTransfersV355Test-1128794915 None] Lock "cinder-ea7ed410-8061-4b1d-a40d-9c26624cafa3-delete_volume" released by "delete_volume" :: held 8.473s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:28 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=12,cinder:UPDATE=25,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:02:30 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:02:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Flow 'volume_create_manager' (436da13b-5b00-4f68-943d-e4c2604b0a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:02:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c74adc39-7797-4664-9560-2e2bff18ed19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c74adc39-7797-4664-9560-2e2bff18ed19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1631594059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bda86c5-1ba4-4de7-acd2-c7134eecd099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c49cb35c068349afb3b688d59bc80fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:02:30Z,use_quota=True,user_id='ab6d012b4df04b8182985add9e6501c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156d711a-2d66-40f1-a9af-7eeba8b2d3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156d711a-2d66-40f1-a9af-7eeba8b2d3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e5eae2-c557-4317-9338-c6077560a653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e5eae2-c557-4317-9338-c6077560a653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bda86c5-1ba4-4de7-acd2-c7134eecd099', 'volume_name': 'volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53cb77ff-cc3d-4566-b5c1-51ba309eb185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53cb77ff-cc3d-4566-b5c1-51ba309eb185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94bb936b-0dc9-45b0-bbfb-220741ea5852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:30 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Volume 7bda86c5-1ba4-4de7-acd2-c7134eecd099: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099', 'volume_size': 1}
Jul 03 13:02:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1631594059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bda86c5-1ba4-4de7-acd2-c7134eecd099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c49cb35c068349afb3b688d59bc80fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:02:30Z,use_quota=True,user_id='ab6d012b4df04b8182985add9e6501c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:02:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Creating volume 7bda86c5-1ba4-4de7-acd2-c7134eecd099 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:02:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:02:30 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:02:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:30 devstack sudo[90979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099 1073741824
Jul 03 13:02:30 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:31 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099 1073741824" returned: 0 in 1.008s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:31 devstack sudo[90985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099
Jul 03 13:02:31 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:32 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099" returned: 0 in 0.734s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] <== create_volume: return (1801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:02:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94bb936b-0dc9-45b0-bbfb-220741ea5852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8b55e6-ef3f-4652-8930-d446ee4df9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:32 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Volume volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099 (7bda86c5-1ba4-4de7-acd2-c7134eecd099): created successfully
Jul 03 13:02:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8b55e6-ef3f-4652-8930-d446ee4df9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Flow 'volume_create_manager' (436da13b-5b00-4f68-943d-e4c2604b0a18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:02:32 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-c85e7506-5a67-459a-b4c7-44ebbcc0bb74 tempest-VolumesCloneTest-588148516 None] Created volume successfully.
Jul 03 13:02:33 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:02:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Flow 'volume_create_manager' (92860882-4810-43cd-9181-9754d6d6ddf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:02:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798b32d2-d945-494d-be45-7ec88f0bd4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798b32d2-d945-494d-be45-7ec88f0bd4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1765382578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b7bc6b6-3ed2-458c-94b7-fa299545176a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c49cb35c068349afb3b688d59bc80fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:02:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=7bda86c5-1ba4-4de7-acd2-c7134eecd099,status='creating',terminated_at=None,updated_at=2026-07-03T11:02:33Z,use_quota=True,user_id='ab6d012b4df04b8182985add9e6501c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57890151-efdf-4b04-aab5-0464b8dc0ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57890151-efdf-4b04-aab5-0464b8dc0ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d22aa46-7bdc-4200-b973-73a59955df9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d22aa46-7bdc-4200-b973-73a59955df9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2b7bc6b6-3ed2-458c-94b7-fa299545176a', 'volume_name': 'volume-2b7bc6b6-3ed2-458c-94b7-fa299545176a', 'volume_size': 2, 'source_volid': '7bda86c5-1ba4-4de7-acd2-c7134eecd099', 'source_volstatus': 'available'}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d773f6-6752-4ac0-9878-535d8ab853ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d773f6-6752-4ac0-9878-535d8ab853ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98e123bd-4fa7-4871-95a4-c20a17a3015c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:33 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Volume 2b7bc6b6-3ed2-458c-94b7-fa299545176a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2b7bc6b6-3ed2-458c-94b7-fa299545176a', 'volume_size': 2, 'source_volid': '7bda86c5-1ba4-4de7-acd2-c7134eecd099', 'source_volstatus': 'available'}
Jul 03 13:02:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.004s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:33 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Cloning volume 7bda86c5-1ba4-4de7-acd2-c7134eecd099 to volume 2b7bc6b6-3ed2-458c-94b7-fa299545176a
Jul 03 13:02:33 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Creating offline snapshot 3cd7fd46-7145-4f00-82e7-e3496b2f163b of volume 7bda86c5-1ba4-4de7-acd2-c7134eecd099 {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:02:33 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e61b0f-2a82-422f-abb3-7f3eafae892e]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:33 devstack sudo[90989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099
Jul 03 13:02:33 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:34 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099" returned: 0 in 1.034s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.3cd7fd46-7145-4f00-82e7-e3496b2f163b 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:34 devstack sudo[90994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.3cd7fd46-7145-4f00-82e7-e3496b2f163b 1G
Jul 03 13:02:34 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:35 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.3cd7fd46-7145-4f00-82e7-e3496b2f163b 1G" returned: 0 in 0.951s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.3cd7fd46-7145-4f00-82e7-e3496b2f163b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:35 devstack sudo[91018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.3cd7fd46-7145-4f00-82e7-e3496b2f163b
Jul 03 13:02:35 devstack sudo[91018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:36 devstack sudo[91018]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.3cd7fd46-7145-4f00-82e7-e3496b2f163b" returned: 0 in 0.761s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:36 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.3cd7fd46-7145-4f00-82e7-e3496b2f163b is being set with open permissions: ugo+rw
Jul 03 13:02:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.3cd7fd46-7145-4f00-82e7-e3496b2f163b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:36 devstack sudo[91024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.3cd7fd46-7145-4f00-82e7-e3496b2f163b
Jul 03 13:02:36 devstack sudo[91024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:36 devstack sudo[91024]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.3cd7fd46-7145-4f00-82e7-e3496b2f163b" returned: 0 in 0.660s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:37 devstack sudo[91028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.info
Jul 03 13:02:37 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:37 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.info" returned: 0 in 0.788s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:37 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.info is being set with open permissions: ugo+rw
Jul 03 13:02:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:37 devstack sudo[91059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.info
Jul 03 13:02:37 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:38 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.info" returned: 0 in 0.698s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:38 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Acquiring lock "cinder-quobyte-2b7bc6b6-3ed2-458c-94b7-fa299545176a" by "_copy_volume_from_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:38 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Lock "cinder-quobyte-2b7bc6b6-3ed2-458c-94b7-fa299545176a" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:38 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] snapshot: 3cd7fd46-7145-4f00-82e7-e3496b2f163b, volume: 2b7bc6b6-3ed2-458c-94b7-fa299545176a,  {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 13:02:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:38 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:38 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:38 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f02367c-3255-4b5f-8b63-fa07ccdc8ac7]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.3cd7fd46-7145-4f00-82e7-e3496b2f163b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:38 devstack sudo[91062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.3cd7fd46-7145-4f00-82e7-e3496b2f163b
Jul 03 13:02:38 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:39 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.3cd7fd46-7145-4f00-82e7-e3496b2f163b" returned: 0 in 0.793s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:02:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099 {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 13:02:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Creating direct copy from snapshot {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 13:02:39 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[949037a7-635c-4426-9643-ae508106372a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:39 devstack sudo[91067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099
Jul 03 13:02:39 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:40 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099" returned: 0 in 0.769s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:40 devstack cinder-volume[86837]: DEBUG cinder.utils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Path /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b7bc6b6-3ed2-458c-94b7-fa299545176a not found in is_blk_device check {{(pid=86837) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 13:02:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b7bc6b6-3ed2-458c-94b7-fa299545176a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:40 devstack sudo[91072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b7bc6b6-3ed2-458c-94b7-fa299545176a
Jul 03 13:02:40 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:43 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=4 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:02:46 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b7bc6b6-3ed2-458c-94b7-fa299545176a" returned: 0 in 6.407s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:46 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e0706f-c1c3-43d4-a231-e1229af57224]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:46 devstack sudo[91103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099
Jul 03 13:02:46 devstack sudo[91103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:46 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=23,cinder:UPDATE=23,cinder:INSERT=7,cinder:DELETE=4 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:02:47 devstack sudo[91103]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099" returned: 0 in 1.304s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:47 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099, size 1024.00 MB, duration 6.41 sec, destination /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b7bc6b6-3ed2-458c-94b7-fa299545176a {{(pid=86837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 13:02:47 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Converted 1024.00 MB image at 159.79 MB/s
Jul 03 13:02:47 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b7bc6b6-3ed2-458c-94b7-fa299545176a is being set with open permissions: ugo+rw
Jul 03 13:02:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b7bc6b6-3ed2-458c-94b7-fa299545176a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:47 devstack sudo[91149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b7bc6b6-3ed2-458c-94b7-fa299545176a
Jul 03 13:02:47 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:48 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b7bc6b6-3ed2-458c-94b7-fa299545176a" returned: 0 in 0.948s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:48 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:02:48 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Flow 'volume_create_manager' (fc455a34-9866-48b4-baf3-3486da596336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:02:48 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd482452-b793-45e1-9d7f-d1277645385e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:48 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Lock "cinder-quobyte-2b7bc6b6-3ed2-458c-94b7-fa299545176a" released by "_copy_volume_from_snapshot" :: held 10.334s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:48 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Acquiring lock "cinder-quobyte-3cd7fd46-7145-4f00-82e7-e3496b2f163b" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:48 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd482452-b793-45e1-9d7f-d1277645385e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-628962248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6054761-77fc-4e51-91fe-f49d1caaff41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee5780dc844b4377a0a1f08930dfe923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:02:49Z,use_quota=True,user_id='33f844438e40491ca2eaeeb9d6b78052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:48 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cbde6a0-f1d5-44a4-9fd5-8f44d6a81206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:48 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cbde6a0-f1d5-44a4-9fd5-8f44d6a81206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:48 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d85fbf09-eef0-415f-a8b0-528788719a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:48 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d85fbf09-eef0-415f-a8b0-528788719a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6054761-77fc-4e51-91fe-f49d1caaff41', 'volume_name': 'volume-c6054761-77fc-4e51-91fe-f49d1caaff41', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:48 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12b7f4a1-3ba5-4277-8b23-f87c52cc88d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:48 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12b7f4a1-3ba5-4277-8b23-f87c52cc88d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:48 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a43865-a416-4abc-8882-76e73558ad1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:48 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Volume c6054761-77fc-4e51-91fe-f49d1caaff41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6054761-77fc-4e51-91fe-f49d1caaff41', 'volume_size': 1}
Jul 03 13:02:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:48 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Lock "cinder-quobyte-3cd7fd46-7145-4f00-82e7-e3496b2f163b" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:48 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Deleting offline snapshot 3cd7fd46-7145-4f00-82e7-e3496b2f163b of volume 7bda86c5-1ba4-4de7-acd2-c7134eecd099 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:02:48 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] snapshot_file for this snap is: volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.3cd7fd46-7145-4f00-82e7-e3496b2f163b {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:02:48 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5369e58f-fdab-43ec-aaac-6d747acafb6a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.3cd7fd46-7145-4f00-82e7-e3496b2f163b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:49 devstack sudo[91157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.3cd7fd46-7145-4f00-82e7-e3496b2f163b
Jul 03 13:02:49 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:50 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.3cd7fd46-7145-4f00-82e7-e3496b2f163b" returned: 0 in 1.054s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:50 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:02:50 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6d42d0-5c48-4eb1-956a-8f9975cc3122]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:50 devstack sudo[91178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099
Jul 03 13:02:50 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:51 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099" returned: 0 in 0.929s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.3cd7fd46-7145-4f00-82e7-e3496b2f163b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:51 devstack sudo[91184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.3cd7fd46-7145-4f00-82e7-e3496b2f163b
Jul 03 13:02:51 devstack sudo[91184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:51 devstack sudo[91184]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.3cd7fd46-7145-4f00-82e7-e3496b2f163b" returned: 0 in 0.955s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.3cd7fd46-7145-4f00-82e7-e3496b2f163b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:52 devstack sudo[91189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.3cd7fd46-7145-4f00-82e7-e3496b2f163b
Jul 03 13:02:52 devstack sudo[91189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:52 devstack sudo[91189]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099.3cd7fd46-7145-4f00-82e7-e3496b2f163b" returned: 0 in 0.745s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:52 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Lock "cinder-quobyte-3cd7fd46-7145-4f00-82e7-e3496b2f163b" released by "_delete_snapshot" :: held 3.820s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.363s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.896s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-628962248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6054761-77fc-4e51-91fe-f49d1caaff41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee5780dc844b4377a0a1f08930dfe923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:02:49Z,use_quota=True,user_id='33f844438e40491ca2eaeeb9d6b78052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:02:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Creating volume c6054761-77fc-4e51-91fe-f49d1caaff41 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:02:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:02:52 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:02:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c6054761-77fc-4e51-91fe-f49d1caaff41 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:52 devstack sudo[91193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c6054761-77fc-4e51-91fe-f49d1caaff41 1073741824
Jul 03 13:02:52 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98e123bd-4fa7-4871-95a4-c20a17a3015c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b7bc6b6-3ed2-458c-94b7-fa299545176a', 'volume_size': 2, 'source_volid': '7bda86c5-1ba4-4de7-acd2-c7134eecd099', 'source_volstatus': 'available'}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b92f88-b1d6-4e0f-9c7f-957681d28eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:52 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Volume volume-2b7bc6b6-3ed2-458c-94b7-fa299545176a (2b7bc6b6-3ed2-458c-94b7-fa299545176a): created successfully
Jul 03 13:02:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b92f88-b1d6-4e0f-9c7f-957681d28eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Flow 'volume_create_manager' (92860882-4810-43cd-9181-9754d6d6ddf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:02:52 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-89afb793-17ee-461b-8d66-afb1f091ea7b tempest-VolumesCloneTest-588148516 None] Created volume successfully.
Jul 03 13:02:53 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-dae331b3-ea8c-4e08-a64c-3b170fa9c0fd tempest-VolumesCloneTest-588148516 None] Acquiring lock "cinder-2b7bc6b6-3ed2-458c-94b7-fa299545176a-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:53 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-dae331b3-ea8c-4e08-a64c-3b170fa9c0fd tempest-VolumesCloneTest-588148516 None] Lock "cinder-2b7bc6b6-3ed2-458c-94b7-fa299545176a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:53 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-dae331b3-ea8c-4e08-a64c-3b170fa9c0fd tempest-VolumesCloneTest-588148516 None] Acquiring lock "cinder-quobyte-2b7bc6b6-3ed2-458c-94b7-fa299545176a" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:53 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-dae331b3-ea8c-4e08-a64c-3b170fa9c0fd tempest-VolumesCloneTest-588148516 None] Lock "cinder-quobyte-2b7bc6b6-3ed2-458c-94b7-fa299545176a" acquired by "delete_volume" :: waited 0.024s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:53 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e341e1-226e-4947-bffd-647ebdf4cde3]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dae331b3-ea8c-4e08-a64c-3b170fa9c0fd tempest-VolumesCloneTest-588148516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b7bc6b6-3ed2-458c-94b7-fa299545176a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:53 devstack sudo[91198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b7bc6b6-3ed2-458c-94b7-fa299545176a
Jul 03 13:02:53 devstack sudo[91198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:53 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c6054761-77fc-4e51-91fe-f49d1caaff41 1073741824" returned: 0 in 0.991s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c6054761-77fc-4e51-91fe-f49d1caaff41 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:53 devstack sudo[91201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c6054761-77fc-4e51-91fe-f49d1caaff41
Jul 03 13:02:53 devstack sudo[91201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:54 devstack sudo[91198]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dae331b3-ea8c-4e08-a64c-3b170fa9c0fd tempest-VolumesCloneTest-588148516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b7bc6b6-3ed2-458c-94b7-fa299545176a" returned: 0 in 0.905s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dae331b3-ea8c-4e08-a64c-3b170fa9c0fd tempest-VolumesCloneTest-588148516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b7bc6b6-3ed2-458c-94b7-fa299545176a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:54 devstack sudo[91206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b7bc6b6-3ed2-458c-94b7-fa299545176a
Jul 03 13:02:54 devstack sudo[91206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:54 devstack sudo[91201]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c6054761-77fc-4e51-91fe-f49d1caaff41" returned: 0 in 0.814s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:54 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] <== create_volume: return (1860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:02:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a43865-a416-4abc-8882-76e73558ad1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6054761-77fc-4e51-91fe-f49d1caaff41', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d94032b-64eb-4440-8105-5c644c06edad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:02:54 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Volume volume-c6054761-77fc-4e51-91fe-f49d1caaff41 (c6054761-77fc-4e51-91fe-f49d1caaff41): created successfully
Jul 03 13:02:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d94032b-64eb-4440-8105-5c644c06edad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:02:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Flow 'volume_create_manager' (fc455a34-9866-48b4-baf3-3486da596336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:02:54 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-cbdc5e3a-8f1e-460c-84a1-5740b53cfe66 tempest-AttachVolumeNegativeTest-2100265475 None] Created volume successfully.
Jul 03 13:02:55 devstack sudo[91206]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dae331b3-ea8c-4e08-a64c-3b170fa9c0fd tempest-VolumesCloneTest-588148516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b7bc6b6-3ed2-458c-94b7-fa299545176a" returned: 0 in 0.783s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-dae331b3-ea8c-4e08-a64c-3b170fa9c0fd tempest-VolumesCloneTest-588148516 None] Lock "cinder-quobyte-2b7bc6b6-3ed2-458c-94b7-fa299545176a" released by "delete_volume" :: held 1.739s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:55 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-dae331b3-ea8c-4e08-a64c-3b170fa9c0fd tempest-VolumesCloneTest-588148516 None] Created reservations ['49a94472-4b4f-4bf5-9e63-b9ea17a178f6', 'bb63cc92-85a7-4d7e-adab-7594f9f30e04', 'bde716cb-a1d2-419f-b526-068f5c862784', '084bab9c-9a7b-4b11-a03f-5e47353e63e5'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:02:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-dae331b3-ea8c-4e08-a64c-3b170fa9c0fd tempest-VolumesCloneTest-588148516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-dae331b3-ea8c-4e08-a64c-3b170fa9c0fd tempest-VolumesCloneTest-588148516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:55 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-dae331b3-ea8c-4e08-a64c-3b170fa9c0fd tempest-VolumesCloneTest-588148516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:55 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-dae331b3-ea8c-4e08-a64c-3b170fa9c0fd tempest-VolumesCloneTest-588148516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-dae331b3-ea8c-4e08-a64c-3b170fa9c0fd tempest-VolumesCloneTest-588148516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dae331b3-ea8c-4e08-a64c-3b170fa9c0fd tempest-VolumesCloneTest-588148516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:55 devstack sudo[91210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:02:55 devstack sudo[91210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ba585fc5-fc03-4551-9520-3d6d2b43a60b tempest-AttachVolumeShelveTestJSON-2004640808 None] Acquiring lock "cinder-c464ef63-bb66-4b19-a7a1-f28edac5d68e-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ba585fc5-fc03-4551-9520-3d6d2b43a60b tempest-AttachVolumeShelveTestJSON-2004640808 None] Lock "cinder-c464ef63-bb66-4b19-a7a1-f28edac5d68e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ba585fc5-fc03-4551-9520-3d6d2b43a60b tempest-AttachVolumeShelveTestJSON-2004640808 None] Acquiring lock "cinder-quobyte-c464ef63-bb66-4b19-a7a1-f28edac5d68e" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ba585fc5-fc03-4551-9520-3d6d2b43a60b tempest-AttachVolumeShelveTestJSON-2004640808 None] Lock "cinder-quobyte-c464ef63-bb66-4b19-a7a1-f28edac5d68e" acquired by "delete_volume" :: waited 0.019s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-38665fb0-1849-4fb1-8815-e2ee08ed7639 tempest-VolumesCloneTest-588148516 None] Acquiring lock "cinder-7bda86c5-1ba4-4de7-acd2-c7134eecd099-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:55 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[df25b516-70df-4364-8247-5513a9c4484f]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ba585fc5-fc03-4551-9520-3d6d2b43a60b tempest-AttachVolumeShelveTestJSON-2004640808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c464ef63-bb66-4b19-a7a1-f28edac5d68e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-38665fb0-1849-4fb1-8815-e2ee08ed7639 tempest-VolumesCloneTest-588148516 None] Lock "cinder-7bda86c5-1ba4-4de7-acd2-c7134eecd099-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-38665fb0-1849-4fb1-8815-e2ee08ed7639 tempest-VolumesCloneTest-588148516 None] Acquiring lock "cinder-quobyte-7bda86c5-1ba4-4de7-acd2-c7134eecd099" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:02:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-38665fb0-1849-4fb1-8815-e2ee08ed7639 tempest-VolumesCloneTest-588148516 None] Lock "cinder-quobyte-7bda86c5-1ba4-4de7-acd2-c7134eecd099" acquired by "delete_volume" :: waited 0.022s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:02:56 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9de38b7-93bd-42cb-be1e-51c924c156f1]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-38665fb0-1849-4fb1-8815-e2ee08ed7639 tempest-VolumesCloneTest-588148516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:56 devstack sudo[91216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c464ef63-bb66-4b19-a7a1-f28edac5d68e
Jul 03 13:02:56 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:56 devstack sudo[91218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099
Jul 03 13:02:56 devstack sudo[91218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:56 devstack sudo[91210]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dae331b3-ea8c-4e08-a64c-3b170fa9c0fd tempest-VolumesCloneTest-588148516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.839s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:56 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-dae331b3-ea8c-4e08-a64c-3b170fa9c0fd tempest-VolumesCloneTest-588148516 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:02:56 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-dae331b3-ea8c-4e08-a64c-3b170fa9c0fd tempest-VolumesCloneTest-588148516 None] Deleted volume successfully.
Jul 03 13:02:56 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-dae331b3-ea8c-4e08-a64c-3b170fa9c0fd tempest-VolumesCloneTest-588148516 None] Lock "cinder-2b7bc6b6-3ed2-458c-94b7-fa299545176a-delete_volume" released by "delete_volume" :: held 2.880s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:56 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ba585fc5-fc03-4551-9520-3d6d2b43a60b tempest-AttachVolumeShelveTestJSON-2004640808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c464ef63-bb66-4b19-a7a1-f28edac5d68e" returned: 0 in 1.004s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ba585fc5-fc03-4551-9520-3d6d2b43a60b tempest-AttachVolumeShelveTestJSON-2004640808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c464ef63-bb66-4b19-a7a1-f28edac5d68e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:56 devstack sudo[91227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c464ef63-bb66-4b19-a7a1-f28edac5d68e
Jul 03 13:02:56 devstack sudo[91227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:56 devstack sudo[91218]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-38665fb0-1849-4fb1-8815-e2ee08ed7639 tempest-VolumesCloneTest-588148516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099" returned: 0 in 0.987s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-38665fb0-1849-4fb1-8815-e2ee08ed7639 tempest-VolumesCloneTest-588148516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:57 devstack sudo[91229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099
Jul 03 13:02:57 devstack sudo[91229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:57 devstack sudo[91227]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ba585fc5-fc03-4551-9520-3d6d2b43a60b tempest-AttachVolumeShelveTestJSON-2004640808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c464ef63-bb66-4b19-a7a1-f28edac5d68e" returned: 0 in 0.760s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ba585fc5-fc03-4551-9520-3d6d2b43a60b tempest-AttachVolumeShelveTestJSON-2004640808 None] Lock "cinder-quobyte-c464ef63-bb66-4b19-a7a1-f28edac5d68e" released by "delete_volume" :: held 1.855s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:57 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-ba585fc5-fc03-4551-9520-3d6d2b43a60b tempest-AttachVolumeShelveTestJSON-2004640808 None] Created reservations ['4fe6e1b1-49b5-4e4d-9dc3-c6cca185181a', 'e59ec4f6-c016-422f-9693-8ecf9b52b750', 'f7a9f91f-39ad-4dc9-88f5-8195395c1dbc', '0d6ca08a-9a06-422c-b41e-66977bccea45'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:02:57 devstack sudo[91229]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-38665fb0-1849-4fb1-8815-e2ee08ed7639 tempest-VolumesCloneTest-588148516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7bda86c5-1ba4-4de7-acd2-c7134eecd099" returned: 0 in 0.824s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-38665fb0-1849-4fb1-8815-e2ee08ed7639 tempest-VolumesCloneTest-588148516 None] Lock "cinder-quobyte-7bda86c5-1ba4-4de7-acd2-c7134eecd099" released by "delete_volume" :: held 1.908s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ba585fc5-fc03-4551-9520-3d6d2b43a60b tempest-AttachVolumeShelveTestJSON-2004640808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ba585fc5-fc03-4551-9520-3d6d2b43a60b tempest-AttachVolumeShelveTestJSON-2004640808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ba585fc5-fc03-4551-9520-3d6d2b43a60b tempest-AttachVolumeShelveTestJSON-2004640808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ba585fc5-fc03-4551-9520-3d6d2b43a60b tempest-AttachVolumeShelveTestJSON-2004640808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ba585fc5-fc03-4551-9520-3d6d2b43a60b tempest-AttachVolumeShelveTestJSON-2004640808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ba585fc5-fc03-4551-9520-3d6d2b43a60b tempest-AttachVolumeShelveTestJSON-2004640808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:57 devstack sudo[91235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:02:57 devstack sudo[91235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:57 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-38665fb0-1849-4fb1-8815-e2ee08ed7639 tempest-VolumesCloneTest-588148516 None] Created reservations ['c89b17c7-75e8-45b4-99bc-bc7faff056b4', 'cfac4b9c-89f9-4163-a8fd-43b302657682', '0a243c45-8110-4fd5-bbbd-44a64df3e6ad', '40906227-7d66-4e13-9c35-b05aaf8b9f92'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:02:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-38665fb0-1849-4fb1-8815-e2ee08ed7639 tempest-VolumesCloneTest-588148516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-38665fb0-1849-4fb1-8815-e2ee08ed7639 tempest-VolumesCloneTest-588148516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-38665fb0-1849-4fb1-8815-e2ee08ed7639 tempest-VolumesCloneTest-588148516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:02:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-38665fb0-1849-4fb1-8815-e2ee08ed7639 tempest-VolumesCloneTest-588148516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:02:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-38665fb0-1849-4fb1-8815-e2ee08ed7639 tempest-VolumesCloneTest-588148516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:02:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-38665fb0-1849-4fb1-8815-e2ee08ed7639 tempest-VolumesCloneTest-588148516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:58 devstack sudo[91239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:02:58 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-d6b25a45-9907-44ee-a430-e2c73fda5fa1 req-0aac7fd3-288d-4805-891b-c8987cb8d15b tempest-AttachVolumeNegativeTest-2100265475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:02:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-d6b25a45-9907-44ee-a430-e2c73fda5fa1 req-0aac7fd3-288d-4805-891b-c8987cb8d15b tempest-AttachVolumeNegativeTest-2100265475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:02:58 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e5d9eb-520d-4e42-90d1-e265f53aa744]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:02:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-d6b25a45-9907-44ee-a430-e2c73fda5fa1 req-0aac7fd3-288d-4805-891b-c8987cb8d15b tempest-AttachVolumeNegativeTest-2100265475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c6054761-77fc-4e51-91fe-f49d1caaff41 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:02:59 devstack sudo[91249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c6054761-77fc-4e51-91fe-f49d1caaff41
Jul 03 13:02:59 devstack sudo[91249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:02:59 devstack sudo[91235]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ba585fc5-fc03-4551-9520-3d6d2b43a60b tempest-AttachVolumeShelveTestJSON-2004640808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.446s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:59 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-ba585fc5-fc03-4551-9520-3d6d2b43a60b tempest-AttachVolumeShelveTestJSON-2004640808 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:02:59 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-ba585fc5-fc03-4551-9520-3d6d2b43a60b tempest-AttachVolumeShelveTestJSON-2004640808 None] Deleted volume successfully.
Jul 03 13:02:59 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ba585fc5-fc03-4551-9520-3d6d2b43a60b tempest-AttachVolumeShelveTestJSON-2004640808 None] Lock "cinder-c464ef63-bb66-4b19-a7a1-f28edac5d68e-delete_volume" released by "delete_volume" :: held 3.642s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:02:59 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root
Jul 03 13:02:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-38665fb0-1849-4fb1-8815-e2ee08ed7639 tempest-VolumesCloneTest-588148516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.418s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:02:59 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-38665fb0-1849-4fb1-8815-e2ee08ed7639 tempest-VolumesCloneTest-588148516 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:02:59 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-38665fb0-1849-4fb1-8815-e2ee08ed7639 tempest-VolumesCloneTest-588148516 None] Deleted volume successfully.
Jul 03 13:02:59 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-38665fb0-1849-4fb1-8815-e2ee08ed7639 tempest-VolumesCloneTest-588148516 None] Lock "cinder-7bda86c5-1ba4-4de7-acd2-c7134eecd099-delete_volume" released by "delete_volume" :: held 3.827s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:00 devstack sudo[91249]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-d6b25a45-9907-44ee-a430-e2c73fda5fa1 req-0aac7fd3-288d-4805-891b-c8987cb8d15b tempest-AttachVolumeNegativeTest-2100265475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c6054761-77fc-4e51-91fe-f49d1caaff41" returned: 0 in 1.294s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-d6b25a45-9907-44ee-a430-e2c73fda5fa1 req-0aac7fd3-288d-4805-891b-c8987cb8d15b tempest-AttachVolumeNegativeTest-2100265475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.346s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-d6b25a45-9907-44ee-a430-e2c73fda5fa1 req-0aac7fd3-288d-4805-891b-c8987cb8d15b tempest-AttachVolumeNegativeTest-2100265475 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db', 'name': 'volume-c6054761-77fc-4e51-91fe-f49d1caaff41', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '314b0f67-0d08-4ae4-8145-fc960847132d', 'enforce_multipath': True} {{(pid=86837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 13:03:00 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-d6b25a45-9907-44ee-a430-e2c73fda5fa1 req-0aac7fd3-288d-4805-891b-c8987cb8d15b tempest-AttachVolumeNegativeTest-2100265475 None] attachment_update completed successfully.
Jul 03 13:03:03 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:03:03 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Flow 'volume_create_manager' (b515eba3-08d9-41f1-b167-0819f1ecbdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:03 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26da9d94-72a7-493a-965a-e646d037b64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:03 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26da9d94-72a7-493a-965a-e646d037b64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-243390797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f01c982-3ce5-4642-adc5-300055dcb709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75d84fd6c5ab46c1b766a965ceab065d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:04Z,use_quota=True,user_id='886bab8a77d34276ad6d88252132d1ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:03 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84bda142-5b32-490e-bcf2-16920b7a5592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:03 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84bda142-5b32-490e-bcf2-16920b7a5592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:03 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bae70c-a4a9-4b16-ae96-b05f63c54fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:03 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bae70c-a4a9-4b16-ae96-b05f63c54fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f01c982-3ce5-4642-adc5-300055dcb709', 'volume_name': 'volume-1f01c982-3ce5-4642-adc5-300055dcb709', 'volume_size': 2}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:03 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e22515-9b76-499a-bca9-a5a0c2324bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:03 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e22515-9b76-499a-bca9-a5a0c2324bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:03 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3146bfa4-5a01-46e9-9ff3-0f187f82bde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:03 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Volume 1f01c982-3ce5-4642-adc5-300055dcb709: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f01c982-3ce5-4642-adc5-300055dcb709', 'volume_size': 2}
Jul 03 13:03:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:03 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-243390797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f01c982-3ce5-4642-adc5-300055dcb709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75d84fd6c5ab46c1b766a965ceab065d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:04Z,use_quota=True,user_id='886bab8a77d34276ad6d88252132d1ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:03:03 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Creating volume 1f01c982-3ce5-4642-adc5-300055dcb709 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:03:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:03 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:03 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:03 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:03:03 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:03:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1f01c982-3ce5-4642-adc5-300055dcb709 2147483648 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:03 devstack sudo[91644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1f01c982-3ce5-4642-adc5-300055dcb709 2147483648
Jul 03 13:03:03 devstack sudo[91644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:05 devstack sudo[91644]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1f01c982-3ce5-4642-adc5-300055dcb709 2147483648" returned: 0 in 1.373s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1f01c982-3ce5-4642-adc5-300055dcb709 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:05 devstack sudo[91653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1f01c982-3ce5-4642-adc5-300055dcb709
Jul 03 13:03:05 devstack sudo[91653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:06 devstack sudo[91653]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1f01c982-3ce5-4642-adc5-300055dcb709" returned: 0 in 0.901s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] <== create_volume: return (2353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:03:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.355s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3146bfa4-5a01-46e9-9ff3-0f187f82bde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f01c982-3ce5-4642-adc5-300055dcb709', 'volume_size': 2}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad0fe98b-6e88-4c10-ad70-e98a8a5b7122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:06 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Volume volume-1f01c982-3ce5-4642-adc5-300055dcb709 (1f01c982-3ce5-4642-adc5-300055dcb709): created successfully
Jul 03 13:03:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad0fe98b-6e88-4c10-ad70-e98a8a5b7122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Flow 'volume_create_manager' (b515eba3-08d9-41f1-b167-0819f1ecbdc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:06 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-3528c26c-f089-4c7e-8d80-8e5fb35944bf tempest-VolumesCloneNegativeTest-150743820 None] Created volume successfully.
Jul 03 13:03:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a9f91262-cdc1-4110-adcb-fa23b9f23d18 tempest-VolumesCloneNegativeTest-150743820 None] Acquiring lock "cinder-1f01c982-3ce5-4642-adc5-300055dcb709-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a9f91262-cdc1-4110-adcb-fa23b9f23d18 tempest-VolumesCloneNegativeTest-150743820 None] Lock "cinder-1f01c982-3ce5-4642-adc5-300055dcb709-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a9f91262-cdc1-4110-adcb-fa23b9f23d18 tempest-VolumesCloneNegativeTest-150743820 None] Acquiring lock "cinder-quobyte-1f01c982-3ce5-4642-adc5-300055dcb709" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a9f91262-cdc1-4110-adcb-fa23b9f23d18 tempest-VolumesCloneNegativeTest-150743820 None] Lock "cinder-quobyte-1f01c982-3ce5-4642-adc5-300055dcb709" acquired by "delete_volume" :: waited 0.025s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:07 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[0272c1ec-0562-4ab8-bf89-55e1baee3401]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:03:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a9f91262-cdc1-4110-adcb-fa23b9f23d18 tempest-VolumesCloneNegativeTest-150743820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1f01c982-3ce5-4642-adc5-300055dcb709 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:07 devstack sudo[91658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1f01c982-3ce5-4642-adc5-300055dcb709
Jul 03 13:03:07 devstack sudo[91658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:08 devstack sudo[91658]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a9f91262-cdc1-4110-adcb-fa23b9f23d18 tempest-VolumesCloneNegativeTest-150743820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1f01c982-3ce5-4642-adc5-300055dcb709" returned: 0 in 1.213s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a9f91262-cdc1-4110-adcb-fa23b9f23d18 tempest-VolumesCloneNegativeTest-150743820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1f01c982-3ce5-4642-adc5-300055dcb709 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:08 devstack sudo[91697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1f01c982-3ce5-4642-adc5-300055dcb709
Jul 03 13:03:08 devstack sudo[91697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:09 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:03:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Flow 'volume_create_manager' (62e6a17b-7e3a-4570-b137-e305b6f77c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0d750c-f034-4c45-9bff-be61fd024216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0d750c-f034-4c45-9bff-be61fd024216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-145103169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5cd8e9-f4bf-4bd0-b3da-5b7f048efcba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='09315f22bbd247cd90f1239614f8245c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:09Z,use_quota=True,user_id='decfa175134746558b0a3735f0b1354c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa05e29-ed1a-4011-bafc-3f38551eaf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa05e29-ed1a-4011-bafc-3f38551eaf18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08eda7a7-17e9-48a7-ac30-43366da19cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08eda7a7-17e9-48a7-ac30-43366da19cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e5cd8e9-f4bf-4bd0-b3da-5b7f048efcba', 'volume_name': 'volume-1e5cd8e9-f4bf-4bd0-b3da-5b7f048efcba', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2301110-5ae5-458e-80e4-e68ded1613a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2301110-5ae5-458e-80e4-e68ded1613a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b69b2a3-ac8e-44c0-bcdf-09be76795bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:09 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Volume 1e5cd8e9-f4bf-4bd0-b3da-5b7f048efcba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e5cd8e9-f4bf-4bd0-b3da-5b7f048efcba', 'volume_size': 1}
Jul 03 13:03:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-145103169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5cd8e9-f4bf-4bd0-b3da-5b7f048efcba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='09315f22bbd247cd90f1239614f8245c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:09Z,use_quota=True,user_id='decfa175134746558b0a3735f0b1354c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:03:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Creating volume 1e5cd8e9-f4bf-4bd0-b3da-5b7f048efcba {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:03:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:03:09 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:03:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1e5cd8e9-f4bf-4bd0-b3da-5b7f048efcba 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:09 devstack sudo[91732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1e5cd8e9-f4bf-4bd0-b3da-5b7f048efcba 1073741824
Jul 03 13:03:09 devstack sudo[91732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:09 devstack sudo[91697]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a9f91262-cdc1-4110-adcb-fa23b9f23d18 tempest-VolumesCloneNegativeTest-150743820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1f01c982-3ce5-4642-adc5-300055dcb709" returned: 0 in 1.201s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a9f91262-cdc1-4110-adcb-fa23b9f23d18 tempest-VolumesCloneNegativeTest-150743820 None] Lock "cinder-quobyte-1f01c982-3ce5-4642-adc5-300055dcb709" released by "delete_volume" :: held 2.497s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:09 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-a9f91262-cdc1-4110-adcb-fa23b9f23d18 tempest-VolumesCloneNegativeTest-150743820 None] Created reservations ['554897e4-fad4-4ec0-bbec-24eeb412ad9a', '1705c2b0-ba38-4c0f-9fb1-fdf008fe3b18', '76bca8c9-1196-4efd-8418-35da58a35a56', '6128fb67-7b1d-442a-aa42-69793d09f7f3'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:03:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a9f91262-cdc1-4110-adcb-fa23b9f23d18 tempest-VolumesCloneNegativeTest-150743820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a9f91262-cdc1-4110-adcb-fa23b9f23d18 tempest-VolumesCloneNegativeTest-150743820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:10 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a9f91262-cdc1-4110-adcb-fa23b9f23d18 tempest-VolumesCloneNegativeTest-150743820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:10 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a9f91262-cdc1-4110-adcb-fa23b9f23d18 tempest-VolumesCloneNegativeTest-150743820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a9f91262-cdc1-4110-adcb-fa23b9f23d18 tempest-VolumesCloneNegativeTest-150743820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a9f91262-cdc1-4110-adcb-fa23b9f23d18 tempest-VolumesCloneNegativeTest-150743820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:10 devstack sudo[91749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:03:10 devstack sudo[91749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:10 devstack sudo[91732]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1e5cd8e9-f4bf-4bd0-b3da-5b7f048efcba 1073741824" returned: 0 in 1.451s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1e5cd8e9-f4bf-4bd0-b3da-5b7f048efcba {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:10 devstack sudo[91765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1e5cd8e9-f4bf-4bd0-b3da-5b7f048efcba
Jul 03 13:03:10 devstack sudo[91765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:11 devstack sudo[91749]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a9f91262-cdc1-4110-adcb-fa23b9f23d18 tempest-VolumesCloneNegativeTest-150743820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.043s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:11 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-a9f91262-cdc1-4110-adcb-fa23b9f23d18 tempest-VolumesCloneNegativeTest-150743820 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:03:11 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-a9f91262-cdc1-4110-adcb-fa23b9f23d18 tempest-VolumesCloneNegativeTest-150743820 None] Deleted volume successfully.
Jul 03 13:03:11 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a9f91262-cdc1-4110-adcb-fa23b9f23d18 tempest-VolumesCloneNegativeTest-150743820 None] Lock "cinder-1f01c982-3ce5-4642-adc5-300055dcb709-delete_volume" released by "delete_volume" :: held 3.961s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:11 devstack sudo[91765]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1e5cd8e9-f4bf-4bd0-b3da-5b7f048efcba" returned: 0 in 0.925s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] <== create_volume: return (2457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:03:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.461s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b69b2a3-ac8e-44c0-bcdf-09be76795bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e5cd8e9-f4bf-4bd0-b3da-5b7f048efcba', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b204a76d-6ba1-434d-9218-8c8f8a9be149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:11 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Volume volume-1e5cd8e9-f4bf-4bd0-b3da-5b7f048efcba (1e5cd8e9-f4bf-4bd0-b3da-5b7f048efcba): created successfully
Jul 03 13:03:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b204a76d-6ba1-434d-9218-8c8f8a9be149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Flow 'volume_create_manager' (62e6a17b-7e3a-4570-b137-e305b6f77c7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:11 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-76a01854-13a0-479e-aaaf-377005a44863 req-6ac67936-20cc-46d6-b057-1fca6dfad16b tempest-VolumesGetTestJSON-161655767 None] Created volume successfully.
Jul 03 13:03:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [req-ebab971a-548a-45a0-be5d-e568a0b5ecd6 req-bbe7655c-3ecb-4baa-a95b-0254336496a9 tempest-VolumesGetTestJSON-161655767 None] Acquiring lock "cinder-1e5cd8e9-f4bf-4bd0-b3da-5b7f048efcba-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [req-ebab971a-548a-45a0-be5d-e568a0b5ecd6 req-bbe7655c-3ecb-4baa-a95b-0254336496a9 tempest-VolumesGetTestJSON-161655767 None] Lock "cinder-1e5cd8e9-f4bf-4bd0-b3da-5b7f048efcba-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [req-ebab971a-548a-45a0-be5d-e568a0b5ecd6 req-bbe7655c-3ecb-4baa-a95b-0254336496a9 tempest-VolumesGetTestJSON-161655767 None] Acquiring lock "cinder-quobyte-1e5cd8e9-f4bf-4bd0-b3da-5b7f048efcba" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [req-ebab971a-548a-45a0-be5d-e568a0b5ecd6 req-bbe7655c-3ecb-4baa-a95b-0254336496a9 tempest-VolumesGetTestJSON-161655767 None] Lock "cinder-quobyte-1e5cd8e9-f4bf-4bd0-b3da-5b7f048efcba" acquired by "delete_volume" :: waited 0.018s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:13 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5fd329-9b0e-4be8-ac6c-0af438d87add]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:03:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-ebab971a-548a-45a0-be5d-e568a0b5ecd6 req-bbe7655c-3ecb-4baa-a95b-0254336496a9 tempest-VolumesGetTestJSON-161655767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1e5cd8e9-f4bf-4bd0-b3da-5b7f048efcba {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:13 devstack sudo[91777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1e5cd8e9-f4bf-4bd0-b3da-5b7f048efcba
Jul 03 13:03:13 devstack sudo[91777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:14 devstack sudo[91777]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-ebab971a-548a-45a0-be5d-e568a0b5ecd6 req-bbe7655c-3ecb-4baa-a95b-0254336496a9 tempest-VolumesGetTestJSON-161655767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1e5cd8e9-f4bf-4bd0-b3da-5b7f048efcba" returned: 0 in 1.009s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-ebab971a-548a-45a0-be5d-e568a0b5ecd6 req-bbe7655c-3ecb-4baa-a95b-0254336496a9 tempest-VolumesGetTestJSON-161655767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1e5cd8e9-f4bf-4bd0-b3da-5b7f048efcba {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:14 devstack sudo[91782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1e5cd8e9-f4bf-4bd0-b3da-5b7f048efcba
Jul 03 13:03:14 devstack sudo[91782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:03:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:14 devstack sudo[91784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:03:14 devstack sudo[91784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:15 devstack sudo[91782]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-ebab971a-548a-45a0-be5d-e568a0b5ecd6 req-bbe7655c-3ecb-4baa-a95b-0254336496a9 tempest-VolumesGetTestJSON-161655767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1e5cd8e9-f4bf-4bd0-b3da-5b7f048efcba" returned: 0 in 0.950s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:15 devstack cinder-volume[86837]: DEBUG cinder.coordination [req-ebab971a-548a-45a0-be5d-e568a0b5ecd6 req-bbe7655c-3ecb-4baa-a95b-0254336496a9 tempest-VolumesGetTestJSON-161655767 None] Lock "cinder-quobyte-1e5cd8e9-f4bf-4bd0-b3da-5b7f048efcba" released by "delete_volume" :: held 2.018s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:15 devstack cinder-volume[86837]: DEBUG cinder.quota [req-ebab971a-548a-45a0-be5d-e568a0b5ecd6 req-bbe7655c-3ecb-4baa-a95b-0254336496a9 tempest-VolumesGetTestJSON-161655767 None] Created reservations ['bf07d43d-c23a-4eea-9f54-354820f047cd', '31810952-740c-4ab8-8140-99dc43fc105d', 'ca93c2bb-b89b-49b5-97fe-bcf1ce9b9691', '96ce97a5-689a-49cd-bccc-e339b9080b30'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:03:15 devstack sudo[91784]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.061s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:16 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:03:16 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:03:16 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 8 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:03:16 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:03:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-ebab971a-548a-45a0-be5d-e568a0b5ecd6 req-bbe7655c-3ecb-4baa-a95b-0254336496a9 tempest-VolumesGetTestJSON-161655767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-ebab971a-548a-45a0-be5d-e568a0b5ecd6 req-bbe7655c-3ecb-4baa-a95b-0254336496a9 tempest-VolumesGetTestJSON-161655767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:16 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [req-ebab971a-548a-45a0-be5d-e568a0b5ecd6 req-bbe7655c-3ecb-4baa-a95b-0254336496a9 tempest-VolumesGetTestJSON-161655767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:16 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [req-ebab971a-548a-45a0-be5d-e568a0b5ecd6 req-bbe7655c-3ecb-4baa-a95b-0254336496a9 tempest-VolumesGetTestJSON-161655767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-ebab971a-548a-45a0-be5d-e568a0b5ecd6 req-bbe7655c-3ecb-4baa-a95b-0254336496a9 tempest-VolumesGetTestJSON-161655767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-ebab971a-548a-45a0-be5d-e568a0b5ecd6 req-bbe7655c-3ecb-4baa-a95b-0254336496a9 tempest-VolumesGetTestJSON-161655767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:16 devstack sudo[91797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:03:16 devstack sudo[91797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-2705ec05-6cc3-4b3a-b6c1-424bf17a655f req-5b88b4b3-5e74-4b18-b6d2-6b7bf99f23e9 tempest-TaggedAttachmentsTest-1486521284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-2705ec05-6cc3-4b3a-b6c1-424bf17a655f req-5b88b4b3-5e74-4b18-b6d2-6b7bf99f23e9 tempest-TaggedAttachmentsTest-1486521284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:16 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a1c994-68ba-4971-b84f-646f2b6e575f]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:03:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-2705ec05-6cc3-4b3a-b6c1-424bf17a655f req-5b88b4b3-5e74-4b18-b6d2-6b7bf99f23e9 tempest-TaggedAttachmentsTest-1486521284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a6f58936-d9ba-46ca-9779-bbcd5ac108a4 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:16 devstack sudo[91799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a6f58936-d9ba-46ca-9779-bbcd5ac108a4
Jul 03 13:03:16 devstack sudo[91799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:17 devstack sudo[91797]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-ebab971a-548a-45a0-be5d-e568a0b5ecd6 req-bbe7655c-3ecb-4baa-a95b-0254336496a9 tempest-VolumesGetTestJSON-161655767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.969s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:17 devstack cinder-volume[86837]: DEBUG cinder.manager [req-ebab971a-548a-45a0-be5d-e568a0b5ecd6 req-bbe7655c-3ecb-4baa-a95b-0254336496a9 tempest-VolumesGetTestJSON-161655767 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:03:17 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-ebab971a-548a-45a0-be5d-e568a0b5ecd6 req-bbe7655c-3ecb-4baa-a95b-0254336496a9 tempest-VolumesGetTestJSON-161655767 None] Deleted volume successfully.
Jul 03 13:03:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [req-ebab971a-548a-45a0-be5d-e568a0b5ecd6 req-bbe7655c-3ecb-4baa-a95b-0254336496a9 tempest-VolumesGetTestJSON-161655767 None] Lock "cinder-1e5cd8e9-f4bf-4bd0-b3da-5b7f048efcba-delete_volume" released by "delete_volume" :: held 3.547s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:17 devstack sudo[91799]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-2705ec05-6cc3-4b3a-b6c1-424bf17a655f req-5b88b4b3-5e74-4b18-b6d2-6b7bf99f23e9 tempest-TaggedAttachmentsTest-1486521284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a6f58936-d9ba-46ca-9779-bbcd5ac108a4" returned: 0 in 1.533s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-2705ec05-6cc3-4b3a-b6c1-424bf17a655f req-5b88b4b3-5e74-4b18-b6d2-6b7bf99f23e9 tempest-TaggedAttachmentsTest-1486521284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.563s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:18 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-2705ec05-6cc3-4b3a-b6c1-424bf17a655f req-5b88b4b3-5e74-4b18-b6d2-6b7bf99f23e9 tempest-TaggedAttachmentsTest-1486521284 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db', 'name': 'volume-a6f58936-d9ba-46ca-9779-bbcd5ac108a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '15ea2c3c-90b7-44f4-9f41-944537fe862d', 'enforce_multipath': True} {{(pid=86837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 13:03:18 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-2705ec05-6cc3-4b3a-b6c1-424bf17a655f req-5b88b4b3-5e74-4b18-b6d2-6b7bf99f23e9 tempest-TaggedAttachmentsTest-1486521284 None] attachment_update completed successfully.
Jul 03 13:03:25 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-0c3b4da9-2285-4de5-9928-07c2ad538e25 req-1f5cd0ed-e721-49ba-af5b-7e492c9bd096 tempest-TaggedAttachmentsTest-1486521284 None] Terminate volume connection completed successfully.
Jul 03 13:03:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-0c3b4da9-2285-4de5-9928-07c2ad538e25 req-1f5cd0ed-e721-49ba-af5b-7e492c9bd096 tempest-TaggedAttachmentsTest-1486521284 None] Deleting attachment 15ea2c3c-90b7-44f4-9f41-944537fe862d. {{(pid=86837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:03:34 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:UPDATE=50,cinder:SELECT=44,cinder:INSERT=14,cinder:DELETE=1 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:03:35 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=45,cinder:UPDATE=62,cinder:DELETE=8,cinder:INSERT=10 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:03:38 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:03:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Flow 'volume_create_manager' (07dbbde5-25b8-46ad-b598-3b77b1cd036e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0196994f-d194-4a09-9521-9be48d72233e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0196994f-d194-4a09-9521-9be48d72233e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-726496481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a0ceba6-5f4d-4e11-8f6e-695e9a661455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efcf99cf40cb42cfb67a47fd59b63c19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:39Z,use_quota=True,user_id='e9d5e9c823b5419c9ce07abbfe0a2751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cd77cc1-261f-4adc-9998-a795cefc6e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cd77cc1-261f-4adc-9998-a795cefc6e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (210b7f38-da44-410f-94a3-914482e1bbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (210b7f38-da44-410f-94a3-914482e1bbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a0ceba6-5f4d-4e11-8f6e-695e9a661455', 'volume_name': 'volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a838d960-d04e-436e-b517-b4dbfd5d4384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a838d960-d04e-436e-b517-b4dbfd5d4384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d298e2-b584-41e3-b3f5-d6be4934e2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:38 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Volume 6a0ceba6-5f4d-4e11-8f6e-695e9a661455: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455', 'volume_size': 1}
Jul 03 13:03:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:38 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-726496481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a0ceba6-5f4d-4e11-8f6e-695e9a661455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efcf99cf40cb42cfb67a47fd59b63c19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:39Z,use_quota=True,user_id='e9d5e9c823b5419c9ce07abbfe0a2751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:03:38 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Creating volume 6a0ceba6-5f4d-4e11-8f6e-695e9a661455 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:03:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:38 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:38 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:38 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:03:38 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:03:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:39 devstack sudo[91946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455 1073741824
Jul 03 13:03:39 devstack sudo[91946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:39 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:03:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Flow 'volume_create_manager' (3928e07d-88cf-4a7c-a3ef-59542013983e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8139c37-de74-4f56-bd42-32d42eb2ea1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8139c37-de74-4f56-bd42-32d42eb2ea1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-527153508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=703fd5e2-5e79-454f-b1e2-d7830bbec8da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f572ef090524b889314379e249636f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:39Z,use_quota=True,user_id='892a7d9fc5f445df9d6b4d654d0a50ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2963a220-68da-4a58-aa38-c9541c8a97d1),volume_type_id=2963a220-68da-4a58-aa38-c9541c8a97d1)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a58d284-cea2-41fb-a889-cf65b3c3b12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a58d284-cea2-41fb-a889-cf65b3c3b12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40a55a68-de87-40cf-af8b-f5c9650a98ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40a55a68-de87-40cf-af8b-f5c9650a98ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '703fd5e2-5e79-454f-b1e2-d7830bbec8da', 'volume_name': 'volume-703fd5e2-5e79-454f-b1e2-d7830bbec8da', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41389478-b6ca-47bf-a314-bd7c0b467860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41389478-b6ca-47bf-a314-bd7c0b467860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1730ccb7-3357-44d3-aaf4-ab5956dedc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:39 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Volume 703fd5e2-5e79-454f-b1e2-d7830bbec8da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-703fd5e2-5e79-454f-b1e2-d7830bbec8da', 'volume_size': 1}
Jul 03 13:03:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:40 devstack sudo[91946]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455 1073741824" returned: 0 in 1.298s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:40 devstack sudo[91952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455
Jul 03 13:03:40 devstack sudo[91952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:41 devstack sudo[91952]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455" returned: 0 in 0.974s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] <== create_volume: return (2354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:03:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.357s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.062s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-527153508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=703fd5e2-5e79-454f-b1e2-d7830bbec8da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f572ef090524b889314379e249636f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:39Z,use_quota=True,user_id='892a7d9fc5f445df9d6b4d654d0a50ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2963a220-68da-4a58-aa38-c9541c8a97d1),volume_type_id=2963a220-68da-4a58-aa38-c9541c8a97d1)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:03:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Creating volume 703fd5e2-5e79-454f-b1e2-d7830bbec8da {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:03:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:03:41 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:03:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-703fd5e2-5e79-454f-b1e2-d7830bbec8da 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d298e2-b584-41e3-b3f5-d6be4934e2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:41 devstack sudo[91969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-703fd5e2-5e79-454f-b1e2-d7830bbec8da 1073741824
Jul 03 13:03:41 devstack sudo[91969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7dd1e80-c6b7-476b-97e4-0d6372aa7ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:41 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Volume volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455 (6a0ceba6-5f4d-4e11-8f6e-695e9a661455): created successfully
Jul 03 13:03:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7dd1e80-c6b7-476b-97e4-0d6372aa7ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Flow 'volume_create_manager' (07dbbde5-25b8-46ad-b598-3b77b1cd036e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:41 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-c7594e3c-a46e-4444-96f9-93db71cb8ec8 tempest-VolumesSnapshotTestJSON-198537084 None] Created volume successfully.
Jul 03 13:03:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9ac4058e-81fa-4e6c-b754-0f92097b0130 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:42 devstack sudo[91969]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-703fd5e2-5e79-454f-b1e2-d7830bbec8da 1073741824" returned: 0 in 1.144s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-703fd5e2-5e79-454f-b1e2-d7830bbec8da {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:42 devstack sudo[92014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-703fd5e2-5e79-454f-b1e2-d7830bbec8da
Jul 03 13:03:42 devstack sudo[92014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:43 devstack sudo[92014]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-703fd5e2-5e79-454f-b1e2-d7830bbec8da" returned: 0 in 0.728s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:43 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:03:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.919s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9ac4058e-81fa-4e6c-b754-0f92097b0130 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.786s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1730ccb7-3357-44d3-aaf4-ab5956dedc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-703fd5e2-5e79-454f-b1e2-d7830bbec8da', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5805d6-96b1-4b41-be75-364af36dedfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:43 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-9ac4058e-81fa-4e6c-b754-0f92097b0130 tempest-VolumesSnapshotTestJSON-198537084 None] Creating offline snapshot 41a1862a-deea-4d4e-b201-70d38ea4b9bb of volume 6a0ceba6-5f4d-4e11-8f6e-695e9a661455 {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:03:43 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Volume volume-703fd5e2-5e79-454f-b1e2-d7830bbec8da (703fd5e2-5e79-454f-b1e2-d7830bbec8da): created successfully
Jul 03 13:03:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5805d6-96b1-4b41-be75-364af36dedfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Flow 'volume_create_manager' (3928e07d-88cf-4a7c-a3ef-59542013983e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:43 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8ecf6b-63d7-45ac-804a-6612c9f04d92]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:03:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9ac4058e-81fa-4e6c-b754-0f92097b0130 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:43 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-21219aa7-daf9-49f5-9f28-7e7c1a01e665 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Created volume successfully.
Jul 03 13:03:43 devstack sudo[92017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455
Jul 03 13:03:43 devstack sudo[92017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c818a721-acfa-42e5-a0ec-55035323a7cc tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c818a721-acfa-42e5-a0ec-55035323a7cc tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c818a721-acfa-42e5-a0ec-55035323a7cc tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c818a721-acfa-42e5-a0ec-55035323a7cc tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c818a721-acfa-42e5-a0ec-55035323a7cc tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c818a721-acfa-42e5-a0ec-55035323a7cc tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:44 devstack sudo[92020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:03:44 devstack sudo[92020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:44 devstack sudo[92017]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9ac4058e-81fa-4e6c-b754-0f92097b0130 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455" returned: 0 in 1.233s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9ac4058e-81fa-4e6c-b754-0f92097b0130 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455.41a1862a-deea-4d4e-b201-70d38ea4b9bb 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:44 devstack sudo[92026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455.41a1862a-deea-4d4e-b201-70d38ea4b9bb 1G
Jul 03 13:03:44 devstack sudo[92026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:44 devstack sudo[92020]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c818a721-acfa-42e5-a0ec-55035323a7cc tempest-VolumeRetypeWithoutMigrationTest-889033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.858s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:44 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-c818a721-acfa-42e5-a0ec-55035323a7cc tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:03:44 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-c818a721-acfa-42e5-a0ec-55035323a7cc tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Retype volume completed successfully.
Jul 03 13:03:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-389c7d59-41d1-4821-a4b3-e02266fd7183 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Acquiring lock "cinder-703fd5e2-5e79-454f-b1e2-d7830bbec8da-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-389c7d59-41d1-4821-a4b3-e02266fd7183 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Lock "cinder-703fd5e2-5e79-454f-b1e2-d7830bbec8da-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-389c7d59-41d1-4821-a4b3-e02266fd7183 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Acquiring lock "cinder-quobyte-703fd5e2-5e79-454f-b1e2-d7830bbec8da" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-389c7d59-41d1-4821-a4b3-e02266fd7183 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Lock "cinder-quobyte-703fd5e2-5e79-454f-b1e2-d7830bbec8da" acquired by "delete_volume" :: waited 0.034s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:45 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3389e51-9a8e-4df6-8a14-3e0c4ec0bf82]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:03:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-389c7d59-41d1-4821-a4b3-e02266fd7183 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-703fd5e2-5e79-454f-b1e2-d7830bbec8da {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:45 devstack sudo[92026]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9ac4058e-81fa-4e6c-b754-0f92097b0130 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455.41a1862a-deea-4d4e-b201-70d38ea4b9bb 1G" returned: 0 in 1.162s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9ac4058e-81fa-4e6c-b754-0f92097b0130 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455.41a1862a-deea-4d4e-b201-70d38ea4b9bb {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:45 devstack sudo[92036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455.41a1862a-deea-4d4e-b201-70d38ea4b9bb
Jul 03 13:03:45 devstack sudo[92036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:45 devstack sudo[92035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-703fd5e2-5e79-454f-b1e2-d7830bbec8da
Jul 03 13:03:45 devstack sudo[92035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:46 devstack sudo[92036]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9ac4058e-81fa-4e6c-b754-0f92097b0130 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455.41a1862a-deea-4d4e-b201-70d38ea4b9bb" returned: 0 in 1.028s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:46 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-9ac4058e-81fa-4e6c-b754-0f92097b0130 tempest-VolumesSnapshotTestJSON-198537084 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455.41a1862a-deea-4d4e-b201-70d38ea4b9bb is being set with open permissions: ugo+rw
Jul 03 13:03:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9ac4058e-81fa-4e6c-b754-0f92097b0130 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455.41a1862a-deea-4d4e-b201-70d38ea4b9bb {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:46 devstack sudo[92047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455.41a1862a-deea-4d4e-b201-70d38ea4b9bb
Jul 03 13:03:46 devstack sudo[92047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:46 devstack sudo[92035]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-389c7d59-41d1-4821-a4b3-e02266fd7183 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-703fd5e2-5e79-454f-b1e2-d7830bbec8da" returned: 0 in 1.138s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-389c7d59-41d1-4821-a4b3-e02266fd7183 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-703fd5e2-5e79-454f-b1e2-d7830bbec8da {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:46 devstack sudo[92049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-703fd5e2-5e79-454f-b1e2-d7830bbec8da
Jul 03 13:03:46 devstack sudo[92049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:47 devstack sudo[92047]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9ac4058e-81fa-4e6c-b754-0f92097b0130 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455.41a1862a-deea-4d4e-b201-70d38ea4b9bb" returned: 0 in 0.864s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9ac4058e-81fa-4e6c-b754-0f92097b0130 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:47 devstack sudo[92049]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-389c7d59-41d1-4821-a4b3-e02266fd7183 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-703fd5e2-5e79-454f-b1e2-d7830bbec8da" returned: 0 in 0.887s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:47 devstack sudo[92067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455.info
Jul 03 13:03:47 devstack sudo[92067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-389c7d59-41d1-4821-a4b3-e02266fd7183 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Lock "cinder-quobyte-703fd5e2-5e79-454f-b1e2-d7830bbec8da" released by "delete_volume" :: held 2.094s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:47 devstack cinder-volume[86837]: WARNING cinder.quota [None req-389c7d59-41d1-4821-a4b3-e02266fd7183 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:03:47 devstack cinder-volume[86837]: WARNING cinder.quota [None req-389c7d59-41d1-4821-a4b3-e02266fd7183 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:03:47 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-389c7d59-41d1-4821-a4b3-e02266fd7183 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Created reservations ['fe02b336-4c66-4c32-95a4-7ae2307f18cc', '7bad5aac-cf78-4def-8c36-92b18b4c9975', '52560266-774b-45d3-80a2-98dd747aeff4', '8e09526c-a6cb-41ff-b869-5cfe8f3d9d37'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:03:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-389c7d59-41d1-4821-a4b3-e02266fd7183 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-389c7d59-41d1-4821-a4b3-e02266fd7183 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:47 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-389c7d59-41d1-4821-a4b3-e02266fd7183 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:47 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-389c7d59-41d1-4821-a4b3-e02266fd7183 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-389c7d59-41d1-4821-a4b3-e02266fd7183 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-389c7d59-41d1-4821-a4b3-e02266fd7183 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:47 devstack sudo[92069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:03:47 devstack sudo[92069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:48 devstack sudo[92067]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9ac4058e-81fa-4e6c-b754-0f92097b0130 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455.info" returned: 0 in 0.847s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:48 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-9ac4058e-81fa-4e6c-b754-0f92097b0130 tempest-VolumesSnapshotTestJSON-198537084 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455.info is being set with open permissions: ugo+rw
Jul 03 13:03:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9ac4058e-81fa-4e6c-b754-0f92097b0130 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:48 devstack sudo[92072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455.info
Jul 03 13:03:48 devstack sudo[92072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:48 devstack sudo[92069]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-389c7d59-41d1-4821-a4b3-e02266fd7183 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.877s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:48 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-389c7d59-41d1-4821-a4b3-e02266fd7183 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:03:48 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-389c7d59-41d1-4821-a4b3-e02266fd7183 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Deleted volume successfully.
Jul 03 13:03:48 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-389c7d59-41d1-4821-a4b3-e02266fd7183 tempest-VolumeRetypeWithoutMigrationTest-889033667 None] Lock "cinder-703fd5e2-5e79-454f-b1e2-d7830bbec8da-delete_volume" released by "delete_volume" :: held 3.284s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:49 devstack sudo[92072]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9ac4058e-81fa-4e6c-b754-0f92097b0130 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455.info" returned: 0 in 0.736s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9ac4058e-81fa-4e6c-b754-0f92097b0130 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.028s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:49 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-9ac4058e-81fa-4e6c-b754-0f92097b0130 tempest-VolumesSnapshotTestJSON-198537084 None] Create snapshot completed successfully
Jul 03 13:03:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a165cf72-37f1-44d5-9d16-5385c760bec4 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "cinder-41a1862a-deea-4d4e-b201-70d38ea4b9bb-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a165cf72-37f1-44d5-9d16-5385c760bec4 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-41a1862a-deea-4d4e-b201-70d38ea4b9bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a165cf72-37f1-44d5-9d16-5385c760bec4 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "cinder-quobyte-6a0ceba6-5f4d-4e11-8f6e-695e9a661455" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a165cf72-37f1-44d5-9d16-5385c760bec4 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-6a0ceba6-5f4d-4e11-8f6e-695e9a661455" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a165cf72-37f1-44d5-9d16-5385c760bec4 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "cinder-quobyte-41a1862a-deea-4d4e-b201-70d38ea4b9bb" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a165cf72-37f1-44d5-9d16-5385c760bec4 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-41a1862a-deea-4d4e-b201-70d38ea4b9bb" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:50 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-a165cf72-37f1-44d5-9d16-5385c760bec4 tempest-VolumesSnapshotTestJSON-198537084 None] Deleting offline snapshot 41a1862a-deea-4d4e-b201-70d38ea4b9bb of volume 6a0ceba6-5f4d-4e11-8f6e-695e9a661455 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:03:50 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-a165cf72-37f1-44d5-9d16-5385c760bec4 tempest-VolumesSnapshotTestJSON-198537084 None] snapshot_file for this snap is: volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455.41a1862a-deea-4d4e-b201-70d38ea4b9bb {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:03:50 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8af18b-6942-4259-bf32-abeb68419be1]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:03:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a165cf72-37f1-44d5-9d16-5385c760bec4 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455.41a1862a-deea-4d4e-b201-70d38ea4b9bb {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:50 devstack sudo[92084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455.41a1862a-deea-4d4e-b201-70d38ea4b9bb
Jul 03 13:03:50 devstack sudo[92084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:51 devstack sudo[92084]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a165cf72-37f1-44d5-9d16-5385c760bec4 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455.41a1862a-deea-4d4e-b201-70d38ea4b9bb" returned: 0 in 1.185s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-a165cf72-37f1-44d5-9d16-5385c760bec4 tempest-VolumesSnapshotTestJSON-198537084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:03:51 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f121856a-80f3-4f46-8eb3-10ad6f8905ea]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:03:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a165cf72-37f1-44d5-9d16-5385c760bec4 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:51 devstack sudo[92131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455
Jul 03 13:03:51 devstack sudo[92131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:52 devstack sudo[92131]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a165cf72-37f1-44d5-9d16-5385c760bec4 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455" returned: 0 in 1.094s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a165cf72-37f1-44d5-9d16-5385c760bec4 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455.41a1862a-deea-4d4e-b201-70d38ea4b9bb {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:52 devstack sudo[92140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455.41a1862a-deea-4d4e-b201-70d38ea4b9bb
Jul 03 13:03:52 devstack sudo[92140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:53 devstack sudo[92140]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a165cf72-37f1-44d5-9d16-5385c760bec4 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455.41a1862a-deea-4d4e-b201-70d38ea4b9bb" returned: 0 in 1.021s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a165cf72-37f1-44d5-9d16-5385c760bec4 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455.41a1862a-deea-4d4e-b201-70d38ea4b9bb {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:53 devstack sudo[92146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455.41a1862a-deea-4d4e-b201-70d38ea4b9bb
Jul 03 13:03:53 devstack sudo[92146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:54 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-aaf2b535-ae8d-43c4-8de8-5b51711c19e7 tempest-TaggedAttachmentsTest-1486521284 None] Acquiring lock "cinder-a6f58936-d9ba-46ca-9779-bbcd5ac108a4-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:54 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-aaf2b535-ae8d-43c4-8de8-5b51711c19e7 tempest-TaggedAttachmentsTest-1486521284 None] Lock "cinder-a6f58936-d9ba-46ca-9779-bbcd5ac108a4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:54 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-aaf2b535-ae8d-43c4-8de8-5b51711c19e7 tempest-TaggedAttachmentsTest-1486521284 None] Acquiring lock "cinder-quobyte-a6f58936-d9ba-46ca-9779-bbcd5ac108a4" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:03:54 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-aaf2b535-ae8d-43c4-8de8-5b51711c19e7 tempest-TaggedAttachmentsTest-1486521284 None] Lock "cinder-quobyte-a6f58936-d9ba-46ca-9779-bbcd5ac108a4" acquired by "delete_volume" :: waited 0.029s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:03:54 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7d34ee-e541-40bf-b060-29e016a0dd8c]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:03:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aaf2b535-ae8d-43c4-8de8-5b51711c19e7 tempest-TaggedAttachmentsTest-1486521284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a6f58936-d9ba-46ca-9779-bbcd5ac108a4 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:54 devstack sudo[92150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a6f58936-d9ba-46ca-9779-bbcd5ac108a4
Jul 03 13:03:54 devstack sudo[92150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:54 devstack sudo[92146]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a165cf72-37f1-44d5-9d16-5385c760bec4 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455.41a1862a-deea-4d4e-b201-70d38ea4b9bb" returned: 0 in 1.126s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a165cf72-37f1-44d5-9d16-5385c760bec4 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-41a1862a-deea-4d4e-b201-70d38ea4b9bb" released by "_delete_snapshot" :: held 4.601s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a165cf72-37f1-44d5-9d16-5385c760bec4 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-6a0ceba6-5f4d-4e11-8f6e-695e9a661455" released by "delete_snapshot" :: held 4.662s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:55 devstack cinder-volume[86837]: WARNING cinder.quota [None req-a165cf72-37f1-44d5-9d16-5385c760bec4 tempest-VolumesSnapshotTestJSON-198537084 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:03:55 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-a165cf72-37f1-44d5-9d16-5385c760bec4 tempest-VolumesSnapshotTestJSON-198537084 None] Created reservations ['0b098358-17af-4d29-b185-4e64738b169c', '86603c93-0094-4df4-acd8-2f25643be543', '0da34187-6cab-44f9-98e3-7eadfd32b059', '9a76a469-1d2b-4f16-a1d6-d72e4fc4f532'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:03:55 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-a165cf72-37f1-44d5-9d16-5385c760bec4 tempest-VolumesSnapshotTestJSON-198537084 None] Delete snapshot completed successfully.
Jul 03 13:03:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a165cf72-37f1-44d5-9d16-5385c760bec4 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-41a1862a-deea-4d4e-b201-70d38ea4b9bb-delete_snapshot" released by "delete_snapshot" :: held 4.996s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:55 devstack sudo[92150]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aaf2b535-ae8d-43c4-8de8-5b51711c19e7 tempest-TaggedAttachmentsTest-1486521284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a6f58936-d9ba-46ca-9779-bbcd5ac108a4" returned: 0 in 0.972s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aaf2b535-ae8d-43c4-8de8-5b51711c19e7 tempest-TaggedAttachmentsTest-1486521284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a6f58936-d9ba-46ca-9779-bbcd5ac108a4 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:55 devstack sudo[92156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a6f58936-d9ba-46ca-9779-bbcd5ac108a4
Jul 03 13:03:55 devstack sudo[92156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:56 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:03:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Flow 'volume_create_manager' (c27f5f5f-1a06-4f83-88c2-41d7301df433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc48da4-4608-45a8-9773-1854de4bdccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc48da4-4608-45a8-9773-1854de4bdccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1020078316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b6b984-8909-4ece-a5dc-633ae8cfd7f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efcf99cf40cb42cfb67a47fd59b63c19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:57Z,use_quota=True,user_id='e9d5e9c823b5419c9ce07abbfe0a2751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2fdb3e7-dd35-4ee0-8cd6-63ede2bf1bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2fdb3e7-dd35-4ee0-8cd6-63ede2bf1bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72738a51-93c9-4b27-8bfc-4ece21d86e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72738a51-93c9-4b27-8bfc-4ece21d86e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7b6b984-8909-4ece-a5dc-633ae8cfd7f8', 'volume_name': 'volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e14b820-31db-4b74-94c5-cba8f36a648d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e14b820-31db-4b74-94c5-cba8f36a648d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a50def3-d659-4cc0-8d46-469834b3b562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:56 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Volume c7b6b984-8909-4ece-a5dc-633ae8cfd7f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8', 'volume_size': 1}
Jul 03 13:03:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1020078316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b6b984-8909-4ece-a5dc-633ae8cfd7f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efcf99cf40cb42cfb67a47fd59b63c19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:57Z,use_quota=True,user_id='e9d5e9c823b5419c9ce07abbfe0a2751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:03:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Creating volume c7b6b984-8909-4ece-a5dc-633ae8cfd7f8 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:03:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:03:56 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:03:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:56 devstack sudo[92159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8 1073741824
Jul 03 13:03:56 devstack sudo[92159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:56 devstack sudo[92156]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aaf2b535-ae8d-43c4-8de8-5b51711c19e7 tempest-TaggedAttachmentsTest-1486521284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a6f58936-d9ba-46ca-9779-bbcd5ac108a4" returned: 0 in 1.099s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:56 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-aaf2b535-ae8d-43c4-8de8-5b51711c19e7 tempest-TaggedAttachmentsTest-1486521284 None] Lock "cinder-quobyte-a6f58936-d9ba-46ca-9779-bbcd5ac108a4" released by "delete_volume" :: held 2.193s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:57 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-aaf2b535-ae8d-43c4-8de8-5b51711c19e7 tempest-TaggedAttachmentsTest-1486521284 None] Created reservations ['ba4cb053-6afc-4963-b779-e15b5b3df9ca', '19b53d17-16f0-4840-8367-fc5a12d3edce', '1f636c5a-0d5d-4178-9225-b9dead437dac', 'b86666a1-7db8-42d8-9082-1450abec5f66'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:03:57 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:03:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Flow 'volume_create_manager' (5d913696-d270-471f-bc03-b5c4d042ec14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da4d8d5-bbc6-41c3-916f-11c3294070f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aaf2b535-ae8d-43c4-8de8-5b51711c19e7 tempest-TaggedAttachmentsTest-1486521284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aaf2b535-ae8d-43c4-8de8-5b51711c19e7 tempest-TaggedAttachmentsTest-1486521284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aaf2b535-ae8d-43c4-8de8-5b51711c19e7 tempest-TaggedAttachmentsTest-1486521284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aaf2b535-ae8d-43c4-8de8-5b51711c19e7 tempest-TaggedAttachmentsTest-1486521284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aaf2b535-ae8d-43c4-8de8-5b51711c19e7 tempest-TaggedAttachmentsTest-1486521284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aaf2b535-ae8d-43c4-8de8-5b51711c19e7 tempest-TaggedAttachmentsTest-1486521284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da4d8d5-bbc6-41c3-916f-11c3294070f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1151080765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac5f2f65-c84c-4bca-9cd1-b12d2c13b244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='588aeab2d37f4fd2b76fe1af385e91e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:57Z,use_quota=True,user_id='9cf9825590bf4e9ab4c0582aca277394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:57 devstack sudo[92161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:03:57 devstack sudo[92161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a26cee2-c1e9-422b-853b-75de6bd1ad6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a26cee2-c1e9-422b-853b-75de6bd1ad6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b09809a4-654a-4d2c-bd5b-58499694e202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b09809a4-654a-4d2c-bd5b-58499694e202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac5f2f65-c84c-4bca-9cd1-b12d2c13b244', 'volume_name': 'volume-ac5f2f65-c84c-4bca-9cd1-b12d2c13b244', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61a597af-13a1-4d4e-9717-c5d6820d05ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61a597af-13a1-4d4e-9717-c5d6820d05ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5af4471e-4bf6-4f6f-8d8c-a3ff35038f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:57 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Volume ac5f2f65-c84c-4bca-9cd1-b12d2c13b244: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac5f2f65-c84c-4bca-9cd1-b12d2c13b244', 'volume_size': 1}
Jul 03 13:03:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:57 devstack sudo[92159]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8 1073741824" returned: 0 in 1.099s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:57 devstack sudo[92168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8
Jul 03 13:03:57 devstack sudo[92168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:58 devstack sudo[92161]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aaf2b535-ae8d-43c4-8de8-5b51711c19e7 tempest-TaggedAttachmentsTest-1486521284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.769s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:58 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-aaf2b535-ae8d-43c4-8de8-5b51711c19e7 tempest-TaggedAttachmentsTest-1486521284 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:03:58 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-aaf2b535-ae8d-43c4-8de8-5b51711c19e7 tempest-TaggedAttachmentsTest-1486521284 None] Deleted volume successfully.
Jul 03 13:03:58 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-aaf2b535-ae8d-43c4-8de8-5b51711c19e7 tempest-TaggedAttachmentsTest-1486521284 None] Lock "cinder-a6f58936-d9ba-46ca-9779-bbcd5ac108a4-delete_volume" released by "delete_volume" :: held 3.417s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:03:58 devstack sudo[92168]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8" returned: 0 in 0.907s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] <== create_volume: return (2057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:03:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.060s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.410s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1151080765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac5f2f65-c84c-4bca-9cd1-b12d2c13b244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='588aeab2d37f4fd2b76fe1af385e91e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:03:57Z,use_quota=True,user_id='9cf9825590bf4e9ab4c0582aca277394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:03:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Creating volume ac5f2f65-c84c-4bca-9cd1-b12d2c13b244 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:03:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:03:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:03:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:03:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:03:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:03:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:03:58 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:03:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ac5f2f65-c84c-4bca-9cd1-b12d2c13b244 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:03:58 devstack sudo[92172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ac5f2f65-c84c-4bca-9cd1-b12d2c13b244 1073741824
Jul 03 13:03:58 devstack sudo[92172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:03:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a50def3-d659-4cc0-8d46-469834b3b562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e010a826-de2c-4143-a1ab-b1de67a8f077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:03:58 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Volume volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8 (c7b6b984-8909-4ece-a5dc-633ae8cfd7f8): created successfully
Jul 03 13:03:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e010a826-de2c-4143-a1ab-b1de67a8f077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:03:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Flow 'volume_create_manager' (c27f5f5f-1a06-4f83-88c2-41d7301df433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:03:58 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-af5591ee-1971-41c7-9707-2f0c33757f3a tempest-VolumesSnapshotTestJSON-198537084 None] Created volume successfully.
Jul 03 13:03:59 devstack sudo[92172]: pam_unix(sudo:session): session closed for user root
Jul 03 13:03:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ac5f2f65-c84c-4bca-9cd1-b12d2c13b244 1073741824" returned: 0 in 1.124s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:03:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ac5f2f65-c84c-4bca-9cd1-b12d2c13b244 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:00 devstack sudo[92180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ac5f2f65-c84c-4bca-9cd1-b12d2c13b244
Jul 03 13:04:00 devstack sudo[92180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1e34b4d8-b5dd-41be-b152-2728a6e11ce6 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:00 devstack sudo[92180]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ac5f2f65-c84c-4bca-9cd1-b12d2c13b244" returned: 0 in 0.778s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] <== create_volume: return (1978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:04:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.981s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1e34b4d8-b5dd-41be-b152-2728a6e11ce6 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.579s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5af4471e-4bf6-4f6f-8d8c-a3ff35038f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac5f2f65-c84c-4bca-9cd1-b12d2c13b244', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d53b437-bcba-4233-9d97-92bf16ca1dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-1e34b4d8-b5dd-41be-b152-2728a6e11ce6 tempest-VolumesSnapshotTestJSON-198537084 None] Creating offline snapshot 0dbc1b3e-9573-472a-bbed-19b3b90c51fe of volume c7b6b984-8909-4ece-a5dc-633ae8cfd7f8 {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:04:00 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Volume volume-ac5f2f65-c84c-4bca-9cd1-b12d2c13b244 (ac5f2f65-c84c-4bca-9cd1-b12d2c13b244): created successfully
Jul 03 13:04:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d53b437-bcba-4233-9d97-92bf16ca1dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Flow 'volume_create_manager' (5d913696-d270-471f-bc03-b5c4d042ec14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:00 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc1a7bc-1b61-41d9-aa04-313d1f8b02fe]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1e34b4d8-b5dd-41be-b152-2728a6e11ce6 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:00 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-8cf8773e-ae5e-435c-aea5-885beb8456bd tempest-VolumesServicesTestJSON-4237068 None] Created volume successfully.
Jul 03 13:04:01 devstack sudo[92185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8
Jul 03 13:04:01 devstack sudo[92185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:01 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-0519a848-bd0c-4f03-9a81-02348b0a1a22 req-25c0c646-c01d-4891-9867-3dcf24695252 tempest-AttachVolumeNegativeTest-2100265475 None] Terminate volume connection completed successfully.
Jul 03 13:04:01 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-0519a848-bd0c-4f03-9a81-02348b0a1a22 req-25c0c646-c01d-4891-9867-3dcf24695252 tempest-AttachVolumeNegativeTest-2100265475 None] Deleting attachment 314b0f67-0d08-4ae4-8145-fc960847132d. {{(pid=86837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:04:01 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cbaf41f5-4336-4a85-9a08-e73509346ad2 tempest-VolumesServicesTestJSON-4237068 None] Acquiring lock "cinder-ac5f2f65-c84c-4bca-9cd1-b12d2c13b244-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:01 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cbaf41f5-4336-4a85-9a08-e73509346ad2 tempest-VolumesServicesTestJSON-4237068 None] Lock "cinder-ac5f2f65-c84c-4bca-9cd1-b12d2c13b244-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:01 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cbaf41f5-4336-4a85-9a08-e73509346ad2 tempest-VolumesServicesTestJSON-4237068 None] Acquiring lock "cinder-quobyte-ac5f2f65-c84c-4bca-9cd1-b12d2c13b244" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:01 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cbaf41f5-4336-4a85-9a08-e73509346ad2 tempest-VolumesServicesTestJSON-4237068 None] Lock "cinder-quobyte-ac5f2f65-c84c-4bca-9cd1-b12d2c13b244" acquired by "delete_volume" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:01 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[51140bfe-8b6f-4292-8c40-cdb358832c0b]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cbaf41f5-4336-4a85-9a08-e73509346ad2 tempest-VolumesServicesTestJSON-4237068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ac5f2f65-c84c-4bca-9cd1-b12d2c13b244 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:02 devstack sudo[92185]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1e34b4d8-b5dd-41be-b152-2728a6e11ce6 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8" returned: 0 in 1.188s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1e34b4d8-b5dd-41be-b152-2728a6e11ce6 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.0dbc1b3e-9573-472a-bbed-19b3b90c51fe 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:02 devstack sudo[92195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.0dbc1b3e-9573-472a-bbed-19b3b90c51fe 1G
Jul 03 13:04:02 devstack sudo[92194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ac5f2f65-c84c-4bca-9cd1-b12d2c13b244
Jul 03 13:04:02 devstack sudo[92195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:02 devstack sudo[92194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:02 devstack sudo[92194]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cbaf41f5-4336-4a85-9a08-e73509346ad2 tempest-VolumesServicesTestJSON-4237068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ac5f2f65-c84c-4bca-9cd1-b12d2c13b244" returned: 0 in 0.990s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cbaf41f5-4336-4a85-9a08-e73509346ad2 tempest-VolumesServicesTestJSON-4237068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ac5f2f65-c84c-4bca-9cd1-b12d2c13b244 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:02 devstack sudo[92206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ac5f2f65-c84c-4bca-9cd1-b12d2c13b244
Jul 03 13:04:02 devstack sudo[92206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:03 devstack sudo[92195]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1e34b4d8-b5dd-41be-b152-2728a6e11ce6 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.0dbc1b3e-9573-472a-bbed-19b3b90c51fe 1G" returned: 0 in 1.141s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1e34b4d8-b5dd-41be-b152-2728a6e11ce6 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.0dbc1b3e-9573-472a-bbed-19b3b90c51fe {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:03 devstack sudo[92208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.0dbc1b3e-9573-472a-bbed-19b3b90c51fe
Jul 03 13:04:03 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:03 devstack sudo[92206]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cbaf41f5-4336-4a85-9a08-e73509346ad2 tempest-VolumesServicesTestJSON-4237068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ac5f2f65-c84c-4bca-9cd1-b12d2c13b244" returned: 0 in 1.012s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:03 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cbaf41f5-4336-4a85-9a08-e73509346ad2 tempest-VolumesServicesTestJSON-4237068 None] Lock "cinder-quobyte-ac5f2f65-c84c-4bca-9cd1-b12d2c13b244" released by "delete_volume" :: held 2.053s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:03 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-cbaf41f5-4336-4a85-9a08-e73509346ad2 tempest-VolumesServicesTestJSON-4237068 None] Created reservations ['93926683-e88b-4399-8b9c-6b4d43c8dbde', 'faa540e4-e069-4287-8c2c-603dbdeff83f', '792e3255-6318-453b-808d-a503b1289506', '8bf70bc4-67dc-44dd-9d65-d31f93bddc4a'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:04:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cbaf41f5-4336-4a85-9a08-e73509346ad2 tempest-VolumesServicesTestJSON-4237068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cbaf41f5-4336-4a85-9a08-e73509346ad2 tempest-VolumesServicesTestJSON-4237068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-cbaf41f5-4336-4a85-9a08-e73509346ad2 tempest-VolumesServicesTestJSON-4237068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-cbaf41f5-4336-4a85-9a08-e73509346ad2 tempest-VolumesServicesTestJSON-4237068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cbaf41f5-4336-4a85-9a08-e73509346ad2 tempest-VolumesServicesTestJSON-4237068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cbaf41f5-4336-4a85-9a08-e73509346ad2 tempest-VolumesServicesTestJSON-4237068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:04 devstack sudo[92216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:04:04 devstack sudo[92216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:04 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1e34b4d8-b5dd-41be-b152-2728a6e11ce6 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.0dbc1b3e-9573-472a-bbed-19b3b90c51fe" returned: 0 in 1.001s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:04 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-1e34b4d8-b5dd-41be-b152-2728a6e11ce6 tempest-VolumesSnapshotTestJSON-198537084 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.0dbc1b3e-9573-472a-bbed-19b3b90c51fe is being set with open permissions: ugo+rw
Jul 03 13:04:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1e34b4d8-b5dd-41be-b152-2728a6e11ce6 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.0dbc1b3e-9573-472a-bbed-19b3b90c51fe {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:04 devstack sudo[92218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.0dbc1b3e-9573-472a-bbed-19b3b90c51fe
Jul 03 13:04:04 devstack sudo[92218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:05 devstack sudo[92218]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1e34b4d8-b5dd-41be-b152-2728a6e11ce6 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.0dbc1b3e-9573-472a-bbed-19b3b90c51fe" returned: 0 in 0.845s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1e34b4d8-b5dd-41be-b152-2728a6e11ce6 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:05 devstack sudo[92258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.info
Jul 03 13:04:05 devstack sudo[92258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:05 devstack sudo[92216]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cbaf41f5-4336-4a85-9a08-e73509346ad2 tempest-VolumesServicesTestJSON-4237068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.011s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:05 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-cbaf41f5-4336-4a85-9a08-e73509346ad2 tempest-VolumesServicesTestJSON-4237068 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:04:05 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-cbaf41f5-4336-4a85-9a08-e73509346ad2 tempest-VolumesServicesTestJSON-4237068 None] Deleted volume successfully.
Jul 03 13:04:05 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cbaf41f5-4336-4a85-9a08-e73509346ad2 tempest-VolumesServicesTestJSON-4237068 None] Lock "cinder-ac5f2f65-c84c-4bca-9cd1-b12d2c13b244-delete_volume" released by "delete_volume" :: held 3.443s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:05 devstack sudo[92258]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1e34b4d8-b5dd-41be-b152-2728a6e11ce6 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.info" returned: 0 in 0.856s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:05 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-1e34b4d8-b5dd-41be-b152-2728a6e11ce6 tempest-VolumesSnapshotTestJSON-198537084 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.info is being set with open permissions: ugo+rw
Jul 03 13:04:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1e34b4d8-b5dd-41be-b152-2728a6e11ce6 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:05 devstack sudo[92264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.info
Jul 03 13:04:05 devstack sudo[92264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:06 devstack sudo[92264]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1e34b4d8-b5dd-41be-b152-2728a6e11ce6 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.info" returned: 0 in 0.885s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1e34b4d8-b5dd-41be-b152-2728a6e11ce6 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.080s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:06 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-1e34b4d8-b5dd-41be-b152-2728a6e11ce6 tempest-VolumesSnapshotTestJSON-198537084 None] Create snapshot completed successfully
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Flow 'volume_create_manager' (9e49ee81-7b2c-451d-aeb9-3285bddb1c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d40a27d2-d214-43f8-812d-c6f687d83db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d40a27d2-d214-43f8-812d-c6f687d83db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-526217541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41f59e51-329d-47bf-bd49-e855eb31316f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efcf99cf40cb42cfb67a47fd59b63c19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=0dbc1b3e-9573-472a-bbed-19b3b90c51fe,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:08Z,use_quota=True,user_id='e9d5e9c823b5419c9ce07abbfe0a2751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01063068-883b-4cc5-87e3-b0a150e2e0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01063068-883b-4cc5-87e3-b0a150e2e0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506af996-9246-42d6-940d-5675f15b703f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506af996-9246-42d6-940d-5675f15b703f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '41f59e51-329d-47bf-bd49-e855eb31316f', 'volume_name': 'volume-41f59e51-329d-47bf-bd49-e855eb31316f', 'volume_size': 2, 'snapshot_id': '0dbc1b3e-9573-472a-bbed-19b3b90c51fe'}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf402150-ac63-46e0-a028-81ef215dfa69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf402150-ac63-46e0-a028-81ef215dfa69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ab5bf4-cb78-411e-8af4-d5ff9c9ef79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:08 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Volume 41f59e51-329d-47bf-bd49-e855eb31316f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-41f59e51-329d-47bf-bd49-e855eb31316f', 'volume_size': 2, 'snapshot_id': '0dbc1b3e-9573-472a-bbed-19b3b90c51fe'}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "cinder-quobyte-0dbc1b3e-9573-472a-bbed-19b3b90c51fe-41f59e51-329d-47bf-bd49-e855eb31316f" by "_create_volume_from_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-0dbc1b3e-9573-472a-bbed-19b3b90c51fe-41f59e51-329d-47bf-bd49-e855eb31316f" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Creating volume 41f59e51-329d-47bf-bd49-e855eb31316f from snapshot 0dbc1b3e-9573-472a-bbed-19b3b90c51fe {{(pid=86837) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "cinder-quobyte-41f59e51-329d-47bf-bd49-e855eb31316f" by "_copy_volume_from_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-41f59e51-329d-47bf-bd49-e855eb31316f" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] snapshot: 0dbc1b3e-9573-472a-bbed-19b3b90c51fe, volume: 41f59e51-329d-47bf-bd49-e855eb31316f,  {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f224c9-be39-4d06-9a51-d5710d7e5085]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.0dbc1b3e-9573-472a-bbed-19b3b90c51fe {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:08 devstack sudo[92271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.0dbc1b3e-9573-472a-bbed-19b3b90c51fe
Jul 03 13:04:08 devstack sudo[92271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:10 devstack sudo[92271]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.0dbc1b3e-9573-472a-bbed-19b3b90c51fe" returned: 0 in 1.283s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:10 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:04:10 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8 {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 13:04:10 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Creating direct copy from snapshot {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 13:04:10 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbc4c21-0142-46e8-b5ee-9edd55881129]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:10 devstack sudo[92313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8
Jul 03 13:04:10 devstack sudo[92313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:11 devstack sudo[92313]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8" returned: 0 in 0.990s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:11 devstack cinder-volume[86837]: DEBUG cinder.utils [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Path /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-41f59e51-329d-47bf-bd49-e855eb31316f not found in is_blk_device check {{(pid=86837) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 13:04:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-41f59e51-329d-47bf-bd49-e855eb31316f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:11 devstack sudo[92318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-41f59e51-329d-47bf-bd49-e855eb31316f
Jul 03 13:04:11 devstack sudo[92318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:04:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:15 devstack sudo[92335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:04:15 devstack sudo[92335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:17 devstack sudo[92335]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 2.075s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:17 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:04:17 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:04:17 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 8 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:04:17 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:04:18 devstack sudo[92318]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-41f59e51-329d-47bf-bd49-e855eb31316f" returned: 0 in 7.179s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:18 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cb4644-3cf7-495b-b694-22ad3e62e6ab]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:18 devstack sudo[92338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8
Jul 03 13:04:18 devstack sudo[92338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:18 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=50,cinder:UPDATE=43,cinder:DELETE=5,cinder:INSERT=8 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:04:18 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:UPDATE=57,cinder:SELECT=53,cinder:INSERT=14,cinder:DELETE=4 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:04:19 devstack sudo[92338]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8" returned: 0 in 1.424s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:19 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8, size 1024.00 MB, duration 7.18 sec, destination /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-41f59e51-329d-47bf-bd49-e855eb31316f {{(pid=86837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 13:04:19 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Converted 1024.00 MB image at 142.61 MB/s
Jul 03 13:04:19 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-41f59e51-329d-47bf-bd49-e855eb31316f is being set with open permissions: ugo+rw
Jul 03 13:04:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-41f59e51-329d-47bf-bd49-e855eb31316f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:19 devstack sudo[92343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-41f59e51-329d-47bf-bd49-e855eb31316f
Jul 03 13:04:19 devstack sudo[92343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:20 devstack sudo[92343]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-41f59e51-329d-47bf-bd49-e855eb31316f" returned: 0 in 0.898s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-41f59e51-329d-47bf-bd49-e855eb31316f" released by "_copy_volume_from_snapshot" :: held 11.919s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-0dbc1b3e-9573-472a-bbed-19b3b90c51fe-41f59e51-329d-47bf-bd49-e855eb31316f" released by "_create_volume_from_snapshot" :: held 11.965s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.983s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ab5bf4-cb78-411e-8af4-d5ff9c9ef79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41f59e51-329d-47bf-bd49-e855eb31316f', 'volume_size': 2, 'snapshot_id': '0dbc1b3e-9573-472a-bbed-19b3b90c51fe'}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (457b42e5-bfd6-498a-a349-4c0e067879c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:20 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Volume volume-41f59e51-329d-47bf-bd49-e855eb31316f (41f59e51-329d-47bf-bd49-e855eb31316f): created successfully
Jul 03 13:04:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (457b42e5-bfd6-498a-a349-4c0e067879c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Flow 'volume_create_manager' (9e49ee81-7b2c-451d-aeb9-3285bddb1c86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:20 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-28426283-558f-409c-b7c8-209ecd91d0bd tempest-VolumesSnapshotTestJSON-198537084 None] Created volume successfully.
Jul 03 13:04:21 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-34ac81c8-62bb-4112-8441-4a3b63d7f4e2 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "cinder-41f59e51-329d-47bf-bd49-e855eb31316f-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:21 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-34ac81c8-62bb-4112-8441-4a3b63d7f4e2 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-41f59e51-329d-47bf-bd49-e855eb31316f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:21 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-34ac81c8-62bb-4112-8441-4a3b63d7f4e2 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "cinder-quobyte-41f59e51-329d-47bf-bd49-e855eb31316f" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:21 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-34ac81c8-62bb-4112-8441-4a3b63d7f4e2 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-41f59e51-329d-47bf-bd49-e855eb31316f" acquired by "delete_volume" :: waited 0.023s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:21 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb641296-97eb-4eed-b001-2d41cefbf99a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-34ac81c8-62bb-4112-8441-4a3b63d7f4e2 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-41f59e51-329d-47bf-bd49-e855eb31316f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:21 devstack sudo[92352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-41f59e51-329d-47bf-bd49-e855eb31316f
Jul 03 13:04:21 devstack sudo[92352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:22 devstack sudo[92352]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-34ac81c8-62bb-4112-8441-4a3b63d7f4e2 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-41f59e51-329d-47bf-bd49-e855eb31316f" returned: 0 in 1.107s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-34ac81c8-62bb-4112-8441-4a3b63d7f4e2 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-41f59e51-329d-47bf-bd49-e855eb31316f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:22 devstack sudo[92358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-41f59e51-329d-47bf-bd49-e855eb31316f
Jul 03 13:04:22 devstack sudo[92358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:23 devstack sudo[92358]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-34ac81c8-62bb-4112-8441-4a3b63d7f4e2 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-41f59e51-329d-47bf-bd49-e855eb31316f" returned: 0 in 1.129s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-34ac81c8-62bb-4112-8441-4a3b63d7f4e2 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-41f59e51-329d-47bf-bd49-e855eb31316f" released by "delete_volume" :: held 2.317s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:23 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-34ac81c8-62bb-4112-8441-4a3b63d7f4e2 tempest-VolumesSnapshotTestJSON-198537084 None] Created reservations ['2e61e08f-6ea6-45d7-b5d4-3d30f39a50f4', '8c013369-c573-445b-ad4a-9ee02e842eca', '5d1cd908-eb0a-4d3f-89eb-04f89ffac3e1', '87f4b3aa-ea7b-439c-884a-4ded65a86dd5'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:04:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-34ac81c8-62bb-4112-8441-4a3b63d7f4e2 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-34ac81c8-62bb-4112-8441-4a3b63d7f4e2 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-34ac81c8-62bb-4112-8441-4a3b63d7f4e2 tempest-VolumesSnapshotTestJSON-198537084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-34ac81c8-62bb-4112-8441-4a3b63d7f4e2 tempest-VolumesSnapshotTestJSON-198537084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-34ac81c8-62bb-4112-8441-4a3b63d7f4e2 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-34ac81c8-62bb-4112-8441-4a3b63d7f4e2 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:23 devstack sudo[92361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:04:23 devstack sudo[92361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ac436778-91ab-42a0-809c-4130ffba93ef tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "cinder-0dbc1b3e-9573-472a-bbed-19b3b90c51fe-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ac436778-91ab-42a0-809c-4130ffba93ef tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-0dbc1b3e-9573-472a-bbed-19b3b90c51fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ac436778-91ab-42a0-809c-4130ffba93ef tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "cinder-quobyte-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ac436778-91ab-42a0-809c-4130ffba93ef tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ac436778-91ab-42a0-809c-4130ffba93ef tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "cinder-quobyte-0dbc1b3e-9573-472a-bbed-19b3b90c51fe" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ac436778-91ab-42a0-809c-4130ffba93ef tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-0dbc1b3e-9573-472a-bbed-19b3b90c51fe" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-ac436778-91ab-42a0-809c-4130ffba93ef tempest-VolumesSnapshotTestJSON-198537084 None] Deleting offline snapshot 0dbc1b3e-9573-472a-bbed-19b3b90c51fe of volume c7b6b984-8909-4ece-a5dc-633ae8cfd7f8 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:04:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-ac436778-91ab-42a0-809c-4130ffba93ef tempest-VolumesSnapshotTestJSON-198537084 None] snapshot_file for this snap is: volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.0dbc1b3e-9573-472a-bbed-19b3b90c51fe {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:04:25 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[2610012d-f698-4e37-ae96-404f97a44e59]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ac436778-91ab-42a0-809c-4130ffba93ef tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.0dbc1b3e-9573-472a-bbed-19b3b90c51fe {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:25 devstack sudo[92361]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-34ac81c8-62bb-4112-8441-4a3b63d7f4e2 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.332s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:25 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-34ac81c8-62bb-4112-8441-4a3b63d7f4e2 tempest-VolumesSnapshotTestJSON-198537084 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:04:25 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-34ac81c8-62bb-4112-8441-4a3b63d7f4e2 tempest-VolumesSnapshotTestJSON-198537084 None] Deleted volume successfully.
Jul 03 13:04:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-34ac81c8-62bb-4112-8441-4a3b63d7f4e2 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-41f59e51-329d-47bf-bd49-e855eb31316f-delete_volume" released by "delete_volume" :: held 4.024s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:25 devstack sudo[92367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.0dbc1b3e-9573-472a-bbed-19b3b90c51fe
Jul 03 13:04:25 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:26 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:04:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Flow 'volume_create_manager' (fdf8d464-3081-4986-abc9-7bedde3be0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7cbb14-618a-4784-b141-88a0e27b24c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7cbb14-618a-4784-b141-88a0e27b24c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-744536753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db7c942-b017-41fc-828f-acd83969c7df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c8a347cb2354d338ea61d399fe05542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:26Z,use_quota=True,user_id='293f8d1b171a458b9d327953260fe6ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd524c3-5348-4ae4-834e-2ce66c86f9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd524c3-5348-4ae4-834e-2ce66c86f9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b91fd84-0fee-4423-8d06-d8ce7f450d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b91fd84-0fee-4423-8d06-d8ce7f450d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7db7c942-b017-41fc-828f-acd83969c7df', 'volume_name': 'volume-7db7c942-b017-41fc-828f-acd83969c7df', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8398bc9-898a-407e-8556-c97c8f1f39c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8398bc9-898a-407e-8556-c97c8f1f39c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e62e10d-4e2a-4d01-86d2-558488f23e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:26 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Volume 7db7c942-b017-41fc-828f-acd83969c7df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7db7c942-b017-41fc-828f-acd83969c7df', 'volume_size': 1}
Jul 03 13:04:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-744536753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db7c942-b017-41fc-828f-acd83969c7df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c8a347cb2354d338ea61d399fe05542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:26Z,use_quota=True,user_id='293f8d1b171a458b9d327953260fe6ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:04:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Creating volume 7db7c942-b017-41fc-828f-acd83969c7df {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:04:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:04:26 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:04:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:26 devstack sudo[92374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df 1073741824
Jul 03 13:04:26 devstack sudo[92374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:26 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ac436778-91ab-42a0-809c-4130ffba93ef tempest-VolumesSnapshotTestJSON-198537084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.0dbc1b3e-9573-472a-bbed-19b3b90c51fe" returned: 0 in 1.363s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-ac436778-91ab-42a0-809c-4130ffba93ef tempest-VolumesSnapshotTestJSON-198537084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:04:26 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffec9fb-4fb3-4d97-b0cf-637dec5cf2b8]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ac436778-91ab-42a0-809c-4130ffba93ef tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:26 devstack sudo[92376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8
Jul 03 13:04:26 devstack sudo[92376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:27 devstack sudo[92374]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df 1073741824" returned: 0 in 1.449s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:27 devstack sudo[92376]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ac436778-91ab-42a0-809c-4130ffba93ef tempest-VolumesSnapshotTestJSON-198537084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8" returned: 0 in 1.279s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ac436778-91ab-42a0-809c-4130ffba93ef tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.0dbc1b3e-9573-472a-bbed-19b3b90c51fe {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:27 devstack sudo[92385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.0dbc1b3e-9573-472a-bbed-19b3b90c51fe
Jul 03 13:04:27 devstack sudo[92385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:27 devstack sudo[92387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df
Jul 03 13:04:27 devstack sudo[92387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:28 devstack sudo[92387]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df" returned: 0 in 0.995s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:28 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] <== create_volume: return (2579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:04:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.584s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:28 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e62e10d-4e2a-4d01-86d2-558488f23e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7db7c942-b017-41fc-828f-acd83969c7df', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:28 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (830ca967-ca5e-4f09-8417-d9f5c7861a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:28 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Volume volume-7db7c942-b017-41fc-828f-acd83969c7df (7db7c942-b017-41fc-828f-acd83969c7df): created successfully
Jul 03 13:04:28 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (830ca967-ca5e-4f09-8417-d9f5c7861a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:28 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Flow 'volume_create_manager' (fdf8d464-3081-4986-abc9-7bedde3be0d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:29 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-500a987a-d615-436e-be36-108420517dd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Created volume successfully.
Jul 03 13:04:29 devstack sudo[92385]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ac436778-91ab-42a0-809c-4130ffba93ef tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.0dbc1b3e-9573-472a-bbed-19b3b90c51fe" returned: 0 in 1.183s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ac436778-91ab-42a0-809c-4130ffba93ef tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.0dbc1b3e-9573-472a-bbed-19b3b90c51fe {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:29 devstack sudo[92394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.0dbc1b3e-9573-472a-bbed-19b3b90c51fe
Jul 03 13:04:29 devstack sudo[92394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-db371683-54c2-4741-b27d-bcd40aa9792b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-db371683-54c2-4741-b27d-bcd40aa9792b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:29 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-db371683-54c2-4741-b27d-bcd40aa9792b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Creating offline snapshot be0e73e3-ef32-474c-9247-bd1fb6f5c187 of volume 7db7c942-b017-41fc-828f-acd83969c7df {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:04:29 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5830e8b0-5c30-45e4-a020-d5ee000c6f24]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-db371683-54c2-4741-b27d-bcd40aa9792b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:30 devstack sudo[92396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df
Jul 03 13:04:30 devstack sudo[92396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:30 devstack sudo[92394]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ac436778-91ab-42a0-809c-4130ffba93ef tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8.0dbc1b3e-9573-472a-bbed-19b3b90c51fe" returned: 0 in 1.040s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:30 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ac436778-91ab-42a0-809c-4130ffba93ef tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-0dbc1b3e-9573-472a-bbed-19b3b90c51fe" released by "_delete_snapshot" :: held 5.085s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:30 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ac436778-91ab-42a0-809c-4130ffba93ef tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8" released by "delete_snapshot" :: held 5.136s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:30 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-ac436778-91ab-42a0-809c-4130ffba93ef tempest-VolumesSnapshotTestJSON-198537084 None] Created reservations ['20d21b53-2665-40b8-9176-8564780b4728', '5dcd31b5-85c0-4438-9059-c02ea222317f', '73a2bebc-d41d-4f53-a56f-3f99f7c76f6f', 'e65179a0-34f7-4d02-aa60-da1d83fd8776'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:04:30 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-ac436778-91ab-42a0-809c-4130ffba93ef tempest-VolumesSnapshotTestJSON-198537084 None] Delete snapshot completed successfully.
Jul 03 13:04:30 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ac436778-91ab-42a0-809c-4130ffba93ef tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-0dbc1b3e-9573-472a-bbed-19b3b90c51fe-delete_snapshot" released by "delete_snapshot" :: held 5.455s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:31 devstack sudo[92396]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-db371683-54c2-4741-b27d-bcd40aa9792b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df" returned: 0 in 1.181s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-db371683-54c2-4741-b27d-bcd40aa9792b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df.be0e73e3-ef32-474c-9247-bd1fb6f5c187 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:31 devstack sudo[92402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df.be0e73e3-ef32-474c-9247-bd1fb6f5c187 1G
Jul 03 13:04:31 devstack sudo[92402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:31 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-583a719a-b9f4-47d6-bf37-84ede6affaee tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "cinder-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:31 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-583a719a-b9f4-47d6-bf37-84ede6affaee tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:31 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-583a719a-b9f4-47d6-bf37-84ede6affaee tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "cinder-quobyte-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:31 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-583a719a-b9f4-47d6-bf37-84ede6affaee tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8" acquired by "delete_volume" :: waited 0.034s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:32 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4733c57-3ae5-48c7-a1f6-0370d8939eec]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-583a719a-b9f4-47d6-bf37-84ede6affaee tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:32 devstack sudo[92410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8
Jul 03 13:04:32 devstack sudo[92410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:32 devstack sudo[92402]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-db371683-54c2-4741-b27d-bcd40aa9792b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df.be0e73e3-ef32-474c-9247-bd1fb6f5c187 1G" returned: 0 in 1.608s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-db371683-54c2-4741-b27d-bcd40aa9792b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7db7c942-b017-41fc-828f-acd83969c7df -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df.be0e73e3-ef32-474c-9247-bd1fb6f5c187 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:32 devstack sudo[92425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7db7c942-b017-41fc-828f-acd83969c7df -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df.be0e73e3-ef32-474c-9247-bd1fb6f5c187
Jul 03 13:04:32 devstack sudo[92425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:33 devstack sudo[92410]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-583a719a-b9f4-47d6-bf37-84ede6affaee tempest-VolumesSnapshotTestJSON-198537084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8" returned: 0 in 1.408s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-583a719a-b9f4-47d6-bf37-84ede6affaee tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:33 devstack sudo[92436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8
Jul 03 13:04:33 devstack sudo[92436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:33 devstack sudo[92425]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-db371683-54c2-4741-b27d-bcd40aa9792b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7db7c942-b017-41fc-828f-acd83969c7df -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df.be0e73e3-ef32-474c-9247-bd1fb6f5c187" returned: 0 in 1.302s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:33 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-db371683-54c2-4741-b27d-bcd40aa9792b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df.be0e73e3-ef32-474c-9247-bd1fb6f5c187 is being set with open permissions: ugo+rw
Jul 03 13:04:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-db371683-54c2-4741-b27d-bcd40aa9792b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df.be0e73e3-ef32-474c-9247-bd1fb6f5c187 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:34 devstack sudo[92441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df.be0e73e3-ef32-474c-9247-bd1fb6f5c187
Jul 03 13:04:34 devstack sudo[92441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:34 devstack sudo[92436]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-583a719a-b9f4-47d6-bf37-84ede6affaee tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8" returned: 0 in 1.308s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:34 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-583a719a-b9f4-47d6-bf37-84ede6affaee tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8" released by "delete_volume" :: held 2.851s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:34 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-583a719a-b9f4-47d6-bf37-84ede6affaee tempest-VolumesSnapshotTestJSON-198537084 None] Created reservations ['20ffe097-c0ff-4113-bc10-ab9bc428cd6e', '60b911f0-1aeb-4bc8-9871-7a7de52f7f37', 'f6affb1e-fecc-41bc-91af-56d2c7a1ad9a', 'b5cd2c7d-28dc-46c6-956f-66a1682353ad'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:04:34 devstack sudo[92441]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-db371683-54c2-4741-b27d-bcd40aa9792b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df.be0e73e3-ef32-474c-9247-bd1fb6f5c187" returned: 0 in 0.984s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-db371683-54c2-4741-b27d-bcd40aa9792b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:35 devstack sudo[92450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df.info
Jul 03 13:04:35 devstack sudo[92450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-583a719a-b9f4-47d6-bf37-84ede6affaee tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-583a719a-b9f4-47d6-bf37-84ede6affaee tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-583a719a-b9f4-47d6-bf37-84ede6affaee tempest-VolumesSnapshotTestJSON-198537084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-583a719a-b9f4-47d6-bf37-84ede6affaee tempest-VolumesSnapshotTestJSON-198537084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-583a719a-b9f4-47d6-bf37-84ede6affaee tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-583a719a-b9f4-47d6-bf37-84ede6affaee tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:35 devstack sudo[92452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:04:35 devstack sudo[92452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:36 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:04:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Flow 'volume_create_manager' (249db918-a06d-4745-9a55-93d737da9de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d187e6-541d-4dc6-a80b-7a6dfe3ebab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:36 devstack sudo[92452]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:36 devstack sudo[92450]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d187e6-541d-4dc6-a80b-7a6dfe3ebab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1041594520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a188980-f6a1-48da-b1e6-c02c4c8dc315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efcf99cf40cb42cfb67a47fd59b63c19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:36Z,use_quota=True,user_id='e9d5e9c823b5419c9ce07abbfe0a2751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977cf4be-12dc-475d-bbdd-784b25d5f00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977cf4be-12dc-475d-bbdd-784b25d5f00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (783c294e-7658-45cc-9f15-24a549c61cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (783c294e-7658-45cc-9f15-24a549c61cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a188980-f6a1-48da-b1e6-c02c4c8dc315', 'volume_name': 'volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f67df5f-7cd3-4936-a02d-6e0fde5911f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f67df5f-7cd3-4936-a02d-6e0fde5911f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94196919-75ff-4774-889a-b292757d26f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:36 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Volume 6a188980-f6a1-48da-b1e6-c02c4c8dc315: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315', 'volume_size': 1}
Jul 03 13:04:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-583a719a-b9f4-47d6-bf37-84ede6affaee tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.055s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-db371683-54c2-4741-b27d-bcd40aa9792b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df.info" returned: 0 in 1.226s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:36 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-583a719a-b9f4-47d6-bf37-84ede6affaee tempest-VolumesSnapshotTestJSON-198537084 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:04:36 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-db371683-54c2-4741-b27d-bcd40aa9792b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df.info is being set with open permissions: ugo+rw
Jul 03 13:04:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-db371683-54c2-4741-b27d-bcd40aa9792b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:36 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-583a719a-b9f4-47d6-bf37-84ede6affaee tempest-VolumesSnapshotTestJSON-198537084 None] Deleted volume successfully.
Jul 03 13:04:36 devstack sudo[92457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df.info
Jul 03 13:04:36 devstack sudo[92457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:36 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-583a719a-b9f4-47d6-bf37-84ede6affaee tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-c7b6b984-8909-4ece-a5dc-633ae8cfd7f8-delete_volume" released by "delete_volume" :: held 4.503s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:37 devstack sudo[92457]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-db371683-54c2-4741-b27d-bcd40aa9792b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df.info" returned: 0 in 0.754s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-db371683-54c2-4741-b27d-bcd40aa9792b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.242s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.787s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1041594520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a188980-f6a1-48da-b1e6-c02c4c8dc315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efcf99cf40cb42cfb67a47fd59b63c19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:36Z,use_quota=True,user_id='e9d5e9c823b5419c9ce07abbfe0a2751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:04:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Creating volume 6a188980-f6a1-48da-b1e6-c02c4c8dc315 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:04:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:04:37 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:04:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:37 devstack sudo[92460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315 1073741824
Jul 03 13:04:37 devstack sudo[92460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:37 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-db371683-54c2-4741-b27d-bcd40aa9792b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Create snapshot completed successfully
Jul 03 13:04:37 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c25070ac-29a1-4cf1-9f80-6a56706c6674 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Acquiring lock "cinder-be0e73e3-ef32-474c-9247-bd1fb6f5c187-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:37 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c25070ac-29a1-4cf1-9f80-6a56706c6674 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Lock "cinder-be0e73e3-ef32-474c-9247-bd1fb6f5c187-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:37 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c25070ac-29a1-4cf1-9f80-6a56706c6674 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Acquiring lock "cinder-quobyte-7db7c942-b017-41fc-828f-acd83969c7df" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:37 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c25070ac-29a1-4cf1-9f80-6a56706c6674 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Lock "cinder-quobyte-7db7c942-b017-41fc-828f-acd83969c7df" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:37 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c25070ac-29a1-4cf1-9f80-6a56706c6674 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Acquiring lock "cinder-quobyte-be0e73e3-ef32-474c-9247-bd1fb6f5c187" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:37 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c25070ac-29a1-4cf1-9f80-6a56706c6674 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Lock "cinder-quobyte-be0e73e3-ef32-474c-9247-bd1fb6f5c187" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-c25070ac-29a1-4cf1-9f80-6a56706c6674 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Deleting offline snapshot be0e73e3-ef32-474c-9247-bd1fb6f5c187 of volume 7db7c942-b017-41fc-828f-acd83969c7df {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:04:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-c25070ac-29a1-4cf1-9f80-6a56706c6674 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] snapshot_file for this snap is: volume-7db7c942-b017-41fc-828f-acd83969c7df.be0e73e3-ef32-474c-9247-bd1fb6f5c187 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:04:37 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7b3d0c-7173-4095-9477-5e8b2352ce1e]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c25070ac-29a1-4cf1-9f80-6a56706c6674 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df.be0e73e3-ef32-474c-9247-bd1fb6f5c187 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:38 devstack sudo[92466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df.be0e73e3-ef32-474c-9247-bd1fb6f5c187
Jul 03 13:04:38 devstack sudo[92466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315 1073741824" returned: 0 in 1.099s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:38 devstack sudo[92460]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:38 devstack sudo[92472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315
Jul 03 13:04:38 devstack sudo[92472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:39 devstack sudo[92472]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315" returned: 0 in 0.942s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] <== create_volume: return (2121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:04:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.124s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:39 devstack sudo[92466]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c25070ac-29a1-4cf1-9f80-6a56706c6674 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df.be0e73e3-ef32-474c-9247-bd1fb6f5c187" returned: 0 in 1.199s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-c25070ac-29a1-4cf1-9f80-6a56706c6674 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7db7c942-b017-41fc-828f-acd83969c7df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:04:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94196919-75ff-4774-889a-b292757d26f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (983c6d5e-2f51-472a-b96d-cdb22c9b674f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:39 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ebe09d-765a-4846-b6d6-adcfe1eaf616]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c25070ac-29a1-4cf1-9f80-6a56706c6674 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:39 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Volume volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315 (6a188980-f6a1-48da-b1e6-c02c4c8dc315): created successfully
Jul 03 13:04:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (983c6d5e-2f51-472a-b96d-cdb22c9b674f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Flow 'volume_create_manager' (249db918-a06d-4745-9a55-93d737da9de1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:39 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-d1639ad1-cf0c-4d23-aabf-8afed6a5b216 tempest-VolumesSnapshotTestJSON-198537084 None] Created volume successfully.
Jul 03 13:04:39 devstack sudo[92480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df
Jul 03 13:04:39 devstack sudo[92480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:40 devstack sudo[92480]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c25070ac-29a1-4cf1-9f80-6a56706c6674 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df" returned: 0 in 1.745s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c25070ac-29a1-4cf1-9f80-6a56706c6674 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df.be0e73e3-ef32-474c-9247-bd1fb6f5c187 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:41 devstack sudo[92542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df.be0e73e3-ef32-474c-9247-bd1fb6f5c187
Jul 03 13:04:41 devstack sudo[92542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1e704695-b62b-4e7a-87a3-f5a5f98d235d tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1e704695-b62b-4e7a-87a3-f5a5f98d235d tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-1e704695-b62b-4e7a-87a3-f5a5f98d235d tempest-VolumesSnapshotTestJSON-198537084 None] Creating offline snapshot 1b192b33-634c-4e58-90ff-e4b2cd00edfb of volume 6a188980-f6a1-48da-b1e6-c02c4c8dc315 {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:04:41 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[88537234-7192-48be-92fa-4386ad79e352]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1e704695-b62b-4e7a-87a3-f5a5f98d235d tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:41 devstack sudo[92555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315
Jul 03 13:04:41 devstack sudo[92555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:43 devstack sudo[92542]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c25070ac-29a1-4cf1-9f80-6a56706c6674 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df.be0e73e3-ef32-474c-9247-bd1fb6f5c187" returned: 0 in 2.345s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c25070ac-29a1-4cf1-9f80-6a56706c6674 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df.be0e73e3-ef32-474c-9247-bd1fb6f5c187 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:43 devstack sudo[92577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df.be0e73e3-ef32-474c-9247-bd1fb6f5c187
Jul 03 13:04:43 devstack sudo[92577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:44 devstack sudo[92555]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1e704695-b62b-4e7a-87a3-f5a5f98d235d tempest-VolumesSnapshotTestJSON-198537084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315" returned: 0 in 2.583s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1e704695-b62b-4e7a-87a3-f5a5f98d235d tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.1b192b33-634c-4e58-90ff-e4b2cd00edfb 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:44 devstack sudo[92588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.1b192b33-634c-4e58-90ff-e4b2cd00edfb 1G
Jul 03 13:04:44 devstack sudo[92588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:45 devstack sudo[92577]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c25070ac-29a1-4cf1-9f80-6a56706c6674 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df.be0e73e3-ef32-474c-9247-bd1fb6f5c187" returned: 0 in 1.787s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c25070ac-29a1-4cf1-9f80-6a56706c6674 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Lock "cinder-quobyte-be0e73e3-ef32-474c-9247-bd1fb6f5c187" released by "_delete_snapshot" :: held 7.296s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c25070ac-29a1-4cf1-9f80-6a56706c6674 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Lock "cinder-quobyte-7db7c942-b017-41fc-828f-acd83969c7df" released by "delete_snapshot" :: held 7.333s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:45 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-c25070ac-29a1-4cf1-9f80-6a56706c6674 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Created reservations ['8bdba0ad-4733-4431-9371-d5599bd2310f', 'e48369d8-56a5-4bf6-ab1f-de605e6565ec', '629d6844-4965-4ec2-8e6c-e6448c16f0bb', 'c90e9d06-75d5-4a88-9c92-781bd5061426'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:04:45 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-c25070ac-29a1-4cf1-9f80-6a56706c6674 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Delete snapshot completed successfully.
Jul 03 13:04:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c25070ac-29a1-4cf1-9f80-6a56706c6674 tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Lock "cinder-be0e73e3-ef32-474c-9247-bd1fb6f5c187-delete_snapshot" released by "delete_snapshot" :: held 7.718s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:46 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-23f59f14-9d3f-475f-a8a2-f81efff3b19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Acquiring lock "cinder-7db7c942-b017-41fc-828f-acd83969c7df-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:46 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-23f59f14-9d3f-475f-a8a2-f81efff3b19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Lock "cinder-7db7c942-b017-41fc-828f-acd83969c7df-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:46 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-23f59f14-9d3f-475f-a8a2-f81efff3b19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Acquiring lock "cinder-quobyte-7db7c942-b017-41fc-828f-acd83969c7df" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:46 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-23f59f14-9d3f-475f-a8a2-f81efff3b19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Lock "cinder-quobyte-7db7c942-b017-41fc-828f-acd83969c7df" acquired by "delete_volume" :: waited 0.034s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:46 devstack sudo[92588]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1e704695-b62b-4e7a-87a3-f5a5f98d235d tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.1b192b33-634c-4e58-90ff-e4b2cd00edfb 1G" returned: 0 in 2.133s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1e704695-b62b-4e7a-87a3-f5a5f98d235d tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.1b192b33-634c-4e58-90ff-e4b2cd00edfb {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:46 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[00141ac8-ff84-48c6-8aff-9b82aa83b4d0]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-23f59f14-9d3f-475f-a8a2-f81efff3b19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:46 devstack sudo[92605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.1b192b33-634c-4e58-90ff-e4b2cd00edfb
Jul 03 13:04:46 devstack sudo[92605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:46 devstack sudo[92606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df
Jul 03 13:04:46 devstack sudo[92606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-23f59f14-9d3f-475f-a8a2-f81efff3b19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df" returned: 0 in 1.700s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-23f59f14-9d3f-475f-a8a2-f81efff3b19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:48 devstack sudo[92606]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:48 devstack sudo[92618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df
Jul 03 13:04:48 devstack sudo[92618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:48 devstack sudo[92605]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1e704695-b62b-4e7a-87a3-f5a5f98d235d tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.1b192b33-634c-4e58-90ff-e4b2cd00edfb" returned: 0 in 1.966s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:48 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-1e704695-b62b-4e7a-87a3-f5a5f98d235d tempest-VolumesSnapshotTestJSON-198537084 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.1b192b33-634c-4e58-90ff-e4b2cd00edfb is being set with open permissions: ugo+rw
Jul 03 13:04:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1e704695-b62b-4e7a-87a3-f5a5f98d235d tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.1b192b33-634c-4e58-90ff-e4b2cd00edfb {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:48 devstack sudo[92622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.1b192b33-634c-4e58-90ff-e4b2cd00edfb
Jul 03 13:04:48 devstack sudo[92622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-23f59f14-9d3f-475f-a8a2-f81efff3b19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7db7c942-b017-41fc-828f-acd83969c7df" returned: 0 in 1.859s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:49 devstack sudo[92618]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-23f59f14-9d3f-475f-a8a2-f81efff3b19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Lock "cinder-quobyte-7db7c942-b017-41fc-828f-acd83969c7df" released by "delete_volume" :: held 3.799s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:50 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-23f59f14-9d3f-475f-a8a2-f81efff3b19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Created reservations ['731233ee-a1e7-4a30-81eb-0698b44ec724', '841b571d-db30-4b4b-aced-56c6422e95d5', 'de907ce0-b452-4d27-8503-c4676f7cfb70', '33bc8a22-1348-44f6-85dd-cd06443bdf71'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:04:50 devstack sudo[92622]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1e704695-b62b-4e7a-87a3-f5a5f98d235d tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.1b192b33-634c-4e58-90ff-e4b2cd00edfb" returned: 0 in 2.121s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1e704695-b62b-4e7a-87a3-f5a5f98d235d tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:50 devstack sudo[92681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.info
Jul 03 13:04:50 devstack sudo[92681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-23f59f14-9d3f-475f-a8a2-f81efff3b19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-23f59f14-9d3f-475f-a8a2-f81efff3b19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:50 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-23f59f14-9d3f-475f-a8a2-f81efff3b19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-23f59f14-9d3f-475f-a8a2-f81efff3b19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-23f59f14-9d3f-475f-a8a2-f81efff3b19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-23f59f14-9d3f-475f-a8a2-f81efff3b19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:51 devstack sudo[92685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:04:51 devstack sudo[92685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:53 devstack sudo[92681]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1e704695-b62b-4e7a-87a3-f5a5f98d235d tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.info" returned: 0 in 2.527s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:53 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-1e704695-b62b-4e7a-87a3-f5a5f98d235d tempest-VolumesSnapshotTestJSON-198537084 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.info is being set with open permissions: ugo+rw
Jul 03 13:04:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1e704695-b62b-4e7a-87a3-f5a5f98d235d tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:53 devstack sudo[92685]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-23f59f14-9d3f-475f-a8a2-f81efff3b19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 2.249s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:53 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-23f59f14-9d3f-475f-a8a2-f81efff3b19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:04:53 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-23f59f14-9d3f-475f-a8a2-f81efff3b19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Deleted volume successfully.
Jul 03 13:04:53 devstack sudo[92715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.info
Jul 03 13:04:53 devstack sudo[92715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:04:53 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-23f59f14-9d3f-475f-a8a2-f81efff3b19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1411470043 None] Lock "cinder-7db7c942-b017-41fc-828f-acd83969c7df-delete_volume" released by "delete_volume" :: held 7.212s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:04:54 devstack sudo[92715]: pam_unix(sudo:session): session closed for user root
Jul 03 13:04:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1e704695-b62b-4e7a-87a3-f5a5f98d235d tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.info" returned: 0 in 1.772s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:04:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1e704695-b62b-4e7a-87a3-f5a5f98d235d tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 13.550s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:55 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-1e704695-b62b-4e7a-87a3-f5a5f98d235d tempest-VolumesSnapshotTestJSON-198537084 None] Create snapshot completed successfully
Jul 03 13:04:57 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:04:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Flow 'volume_create_manager' (4cb7d7cc-574a-4706-99b2-68bd55ba69c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:04:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d0b86a-8937-41da-b93c-ce4196dd63cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d0b86a-8937-41da-b93c-ce4196dd63cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-190812901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f151b82-62d8-4c57-9ba3-9c53098b2807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efcf99cf40cb42cfb67a47fd59b63c19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1b192b33-634c-4e58-90ff-e4b2cd00edfb,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:04:58Z,use_quota=True,user_id='e9d5e9c823b5419c9ce07abbfe0a2751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b73dd099-0350-439e-b1a6-ea96433b4585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b73dd099-0350-439e-b1a6-ea96433b4585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b3f8a5c-defa-42ba-9c6e-07203cb2a5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b3f8a5c-defa-42ba-9c6e-07203cb2a5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5f151b82-62d8-4c57-9ba3-9c53098b2807', 'volume_name': 'volume-5f151b82-62d8-4c57-9ba3-9c53098b2807', 'volume_size': 1, 'snapshot_id': '1b192b33-634c-4e58-90ff-e4b2cd00edfb'}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f3b1e7-4774-4783-aa7a-97faca6600c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f3b1e7-4774-4783-aa7a-97faca6600c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:04:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcc57e56-7095-43b9-87aa-a19b27158ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:04:57 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Volume 5f151b82-62d8-4c57-9ba3-9c53098b2807: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5f151b82-62d8-4c57-9ba3-9c53098b2807', 'volume_size': 1, 'snapshot_id': '1b192b33-634c-4e58-90ff-e4b2cd00edfb'}
Jul 03 13:04:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:58 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "cinder-quobyte-1b192b33-634c-4e58-90ff-e4b2cd00edfb-5f151b82-62d8-4c57-9ba3-9c53098b2807" by "_create_volume_from_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:58 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-1b192b33-634c-4e58-90ff-e4b2cd00edfb-5f151b82-62d8-4c57-9ba3-9c53098b2807" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Creating volume 5f151b82-62d8-4c57-9ba3-9c53098b2807 from snapshot 1b192b33-634c-4e58-90ff-e4b2cd00edfb {{(pid=86837) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 13:04:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:04:58 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "cinder-quobyte-5f151b82-62d8-4c57-9ba3-9c53098b2807" by "_copy_volume_from_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:04:58 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-5f151b82-62d8-4c57-9ba3-9c53098b2807" acquired by "_copy_volume_from_snapshot" :: waited 0.097s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:04:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] snapshot: 1b192b33-634c-4e58-90ff-e4b2cd00edfb, volume: 5f151b82-62d8-4c57-9ba3-9c53098b2807,  {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 13:04:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:04:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:04:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:04:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:04:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:04:58 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[85de899a-3846-4cda-8bcc-62c700f20d57]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:04:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.1b192b33-634c-4e58-90ff-e4b2cd00edfb {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:04:58 devstack sudo[92795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.1b192b33-634c-4e58-90ff-e4b2cd00edfb
Jul 03 13:04:58 devstack sudo[92795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:00 devstack sudo[92795]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.1b192b33-634c-4e58-90ff-e4b2cd00edfb" returned: 0 in 1.817s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:05:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315 {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 13:05:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Creating direct copy from snapshot {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 13:05:00 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[704124a9-f992-49df-ae32-8ed3f0e59f47]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:05:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:00 devstack sudo[92805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315
Jul 03 13:05:00 devstack sudo[92805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:02 devstack sudo[92805]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315" returned: 0 in 1.754s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:02 devstack cinder-volume[86837]: DEBUG cinder.utils [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Path /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5f151b82-62d8-4c57-9ba3-9c53098b2807 not found in is_blk_device check {{(pid=86837) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 13:05:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5f151b82-62d8-4c57-9ba3-9c53098b2807 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:02 devstack sudo[92814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5f151b82-62d8-4c57-9ba3-9c53098b2807
Jul 03 13:05:02 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:08 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:UPDATE=46,cinder:SELECT=45,cinder:INSERT=14,cinder:DELETE=3 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:05:08 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=35,cinder:UPDATE=47,cinder:DELETE=5,cinder:INSERT=10 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:05:13 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5f151b82-62d8-4c57-9ba3-9c53098b2807" returned: 0 in 11.094s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:13 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb0219e-317e-49c1-abf2-0ab3739131b0]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:05:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:13 devstack sudo[92934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315
Jul 03 13:05:13 devstack sudo[92934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:13 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:05:13 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Flow 'volume_create_manager' (0ba9bb1a-19cc-410d-a49d-c6bfa1fe7784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:05:13 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ae3aa2-442e-4476-949f-fae0c4287df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:13 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ae3aa2-442e-4476-949f-fae0c4287df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-694817810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80139456-8151-471c-a915-1508343f25d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee5780dc844b4377a0a1f08930dfe923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:14Z,use_quota=True,user_id='33f844438e40491ca2eaeeb9d6b78052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:13 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4e91c05-930b-447d-b4e6-94e81205553b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:13 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4e91c05-930b-447d-b4e6-94e81205553b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:13 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d299f6-521f-4413-b6f9-f9a46a4c7834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:13 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d299f6-521f-4413-b6f9-f9a46a4c7834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80139456-8151-471c-a915-1508343f25d9', 'volume_name': 'volume-80139456-8151-471c-a915-1508343f25d9', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:13 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05142664-6fcd-41a7-9a17-8a6fe2ed743c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:13 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05142664-6fcd-41a7-9a17-8a6fe2ed743c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:13 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99f55f7d-552a-475a-b68f-90637a27c584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:13 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Volume 80139456-8151-471c-a915-1508343f25d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80139456-8151-471c-a915-1508343f25d9', 'volume_size': 1}
Jul 03 13:05:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:14 devstack sudo[92934]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315" returned: 0 in 1.217s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:14 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315, size 1024.00 MB, duration 11.10 sec, destination /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5f151b82-62d8-4c57-9ba3-9c53098b2807 {{(pid=86837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 13:05:14 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Converted 1024.00 MB image at 92.29 MB/s
Jul 03 13:05:14 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5f151b82-62d8-4c57-9ba3-9c53098b2807 is being set with open permissions: ugo+rw
Jul 03 13:05:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5f151b82-62d8-4c57-9ba3-9c53098b2807 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:14 devstack sudo[92941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5f151b82-62d8-4c57-9ba3-9c53098b2807
Jul 03 13:05:14 devstack sudo[92941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:05:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:05:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:05:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:15 devstack sudo[92977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:05:15 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:15 devstack sudo[92941]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5f151b82-62d8-4c57-9ba3-9c53098b2807" returned: 0 in 1.330s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:15 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-5f151b82-62d8-4c57-9ba3-9c53098b2807" released by "_copy_volume_from_snapshot" :: held 17.516s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:15 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-1b192b33-634c-4e58-90ff-e4b2cd00edfb-5f151b82-62d8-4c57-9ba3-9c53098b2807" released by "_create_volume_from_snapshot" :: held 17.687s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 17.722s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.753s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:15 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-694817810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80139456-8151-471c-a915-1508343f25d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee5780dc844b4377a0a1f08930dfe923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:14Z,use_quota=True,user_id='33f844438e40491ca2eaeeb9d6b78052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:05:15 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Creating volume 80139456-8151-471c-a915-1508343f25d9 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:05:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:15 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:05:15 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:05:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:15 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:05:15 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:05:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-80139456-8151-471c-a915-1508343f25d9 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:15 devstack sudo[92986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-80139456-8151-471c-a915-1508343f25d9 1073741824
Jul 03 13:05:15 devstack sudo[92986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcc57e56-7095-43b9-87aa-a19b27158ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f151b82-62d8-4c57-9ba3-9c53098b2807', 'volume_size': 1, 'snapshot_id': '1b192b33-634c-4e58-90ff-e4b2cd00edfb'}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91020bca-3c33-4a0c-99e1-e43195a2f99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:15 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Volume volume-5f151b82-62d8-4c57-9ba3-9c53098b2807 (5f151b82-62d8-4c57-9ba3-9c53098b2807): created successfully
Jul 03 13:05:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91020bca-3c33-4a0c-99e1-e43195a2f99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Flow 'volume_create_manager' (4cb7d7cc-574a-4706-99b2-68bd55ba69c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:05:16 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-aaf3db84-787f-467e-80da-bdd5f82ef293 tempest-VolumesSnapshotTestJSON-198537084 None] Created volume successfully.
Jul 03 13:05:16 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.554s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:16 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:05:16 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:05:16 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 8 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:05:16 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:05:16 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9240215f-c817-4c78-b6e1-3876e2be15e3 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "cinder-5f151b82-62d8-4c57-9ba3-9c53098b2807-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:16 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9240215f-c817-4c78-b6e1-3876e2be15e3 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-5f151b82-62d8-4c57-9ba3-9c53098b2807-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9240215f-c817-4c78-b6e1-3876e2be15e3 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "cinder-quobyte-5f151b82-62d8-4c57-9ba3-9c53098b2807" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9240215f-c817-4c78-b6e1-3876e2be15e3 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-5f151b82-62d8-4c57-9ba3-9c53098b2807" acquired by "delete_volume" :: waited 0.024s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:17 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c2217b-c132-4799-90f3-8dfdd2f7915f]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:05:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9240215f-c817-4c78-b6e1-3876e2be15e3 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5f151b82-62d8-4c57-9ba3-9c53098b2807 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:17 devstack sudo[92991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5f151b82-62d8-4c57-9ba3-9c53098b2807
Jul 03 13:05:17 devstack sudo[92991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:18 devstack sudo[92986]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-80139456-8151-471c-a915-1508343f25d9 1073741824" returned: 0 in 2.722s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-80139456-8151-471c-a915-1508343f25d9 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:18 devstack sudo[92997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-80139456-8151-471c-a915-1508343f25d9
Jul 03 13:05:18 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:19 devstack sudo[92991]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9240215f-c817-4c78-b6e1-3876e2be15e3 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5f151b82-62d8-4c57-9ba3-9c53098b2807" returned: 0 in 2.350s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9240215f-c817-4c78-b6e1-3876e2be15e3 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5f151b82-62d8-4c57-9ba3-9c53098b2807 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:19 devstack sudo[93002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5f151b82-62d8-4c57-9ba3-9c53098b2807
Jul 03 13:05:19 devstack sudo[93002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:19 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:05:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Flow 'volume_create_manager' (0ab4944f-635b-416a-af1e-8e4d0dd40fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:05:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (590b6327-89b9-42b1-8963-0c176d0afbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (590b6327-89b9-42b1-8963-0c176d0afbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2047609821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dacb561-a004-42c1-81cc-7db4bd71d97f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173cb5ab90134c78b77080b64b4cb342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:20Z,use_quota=True,user_id='ea15444ece404b13872fe58f8be5cec6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df2552b4-ff8f-4ce5-bf78-3390649e7cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df2552b4-ff8f-4ce5-bf78-3390649e7cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f77f585b-da89-4a96-9139-15d2aac83423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f77f585b-da89-4a96-9139-15d2aac83423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dacb561-a004-42c1-81cc-7db4bd71d97f', 'volume_name': 'volume-5dacb561-a004-42c1-81cc-7db4bd71d97f', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe6cf3fc-053c-42fc-9b0b-b008ee2637e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe6cf3fc-053c-42fc-9b0b-b008ee2637e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a4bb91-edbe-4142-b076-83f3da87380a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:20 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Volume 5dacb561-a004-42c1-81cc-7db4bd71d97f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dacb561-a004-42c1-81cc-7db4bd71d97f', 'volume_size': 1}
Jul 03 13:05:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:20 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-80139456-8151-471c-a915-1508343f25d9" returned: 0 in 1.807s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:20 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] <== create_volume: return (4712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:05:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.718s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.374s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:20 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2047609821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dacb561-a004-42c1-81cc-7db4bd71d97f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173cb5ab90134c78b77080b64b4cb342',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:20Z,use_quota=True,user_id='ea15444ece404b13872fe58f8be5cec6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:05:20 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Creating volume 5dacb561-a004-42c1-81cc-7db4bd71d97f {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:05:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:20 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:05:20 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:05:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:20 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:05:20 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:05:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5dacb561-a004-42c1-81cc-7db4bd71d97f 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:20 devstack sudo[93005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5dacb561-a004-42c1-81cc-7db4bd71d97f 1073741824
Jul 03 13:05:20 devstack sudo[93005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99f55f7d-552a-475a-b68f-90637a27c584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80139456-8151-471c-a915-1508343f25d9', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d46aaa3-a995-4f8a-8c77-48597164e4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:20 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Volume volume-80139456-8151-471c-a915-1508343f25d9 (80139456-8151-471c-a915-1508343f25d9): created successfully
Jul 03 13:05:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d46aaa3-a995-4f8a-8c77-48597164e4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Flow 'volume_create_manager' (0ba9bb1a-19cc-410d-a49d-c6bfa1fe7784) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:05:20 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-99162c5c-d111-45f8-bf10-7d0ebe61fa90 tempest-AttachVolumeNegativeTest-2100265475 None] Created volume successfully.
Jul 03 13:05:20 devstack sudo[93002]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9240215f-c817-4c78-b6e1-3876e2be15e3 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5f151b82-62d8-4c57-9ba3-9c53098b2807" returned: 0 in 1.362s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9240215f-c817-4c78-b6e1-3876e2be15e3 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-5f151b82-62d8-4c57-9ba3-9c53098b2807" released by "delete_volume" :: held 3.805s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:20 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-9240215f-c817-4c78-b6e1-3876e2be15e3 tempest-VolumesSnapshotTestJSON-198537084 None] Created reservations ['dedfca38-77fd-4b93-9928-c942560c4b2f', '9358e6db-e6ba-4bad-8f2b-ffc54c9669bd', '8085c1e5-cea2-424f-a133-96d0464eb369', 'd9d57c09-64c8-466a-b588-53bbe9c23bc9'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:05:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9240215f-c817-4c78-b6e1-3876e2be15e3 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9240215f-c817-4c78-b6e1-3876e2be15e3 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:21 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9240215f-c817-4c78-b6e1-3876e2be15e3 tempest-VolumesSnapshotTestJSON-198537084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:05:21 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9240215f-c817-4c78-b6e1-3876e2be15e3 tempest-VolumesSnapshotTestJSON-198537084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:05:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9240215f-c817-4c78-b6e1-3876e2be15e3 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9240215f-c817-4c78-b6e1-3876e2be15e3 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:21 devstack sudo[93008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:05:21 devstack sudo[93008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:21 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-23a75e29-eee5-4c8e-b15c-cfd2d8727ab5 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "cinder-1b192b33-634c-4e58-90ff-e4b2cd00edfb-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:21 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-23a75e29-eee5-4c8e-b15c-cfd2d8727ab5 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-1b192b33-634c-4e58-90ff-e4b2cd00edfb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:21 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-23a75e29-eee5-4c8e-b15c-cfd2d8727ab5 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "cinder-quobyte-6a188980-f6a1-48da-b1e6-c02c4c8dc315" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:21 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-23a75e29-eee5-4c8e-b15c-cfd2d8727ab5 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-6a188980-f6a1-48da-b1e6-c02c4c8dc315" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:21 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-23a75e29-eee5-4c8e-b15c-cfd2d8727ab5 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "cinder-quobyte-1b192b33-634c-4e58-90ff-e4b2cd00edfb" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:22 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-23a75e29-eee5-4c8e-b15c-cfd2d8727ab5 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-1b192b33-634c-4e58-90ff-e4b2cd00edfb" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:22 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-23a75e29-eee5-4c8e-b15c-cfd2d8727ab5 tempest-VolumesSnapshotTestJSON-198537084 None] Deleting offline snapshot 1b192b33-634c-4e58-90ff-e4b2cd00edfb of volume 6a188980-f6a1-48da-b1e6-c02c4c8dc315 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:05:22 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-23a75e29-eee5-4c8e-b15c-cfd2d8727ab5 tempest-VolumesSnapshotTestJSON-198537084 None] snapshot_file for this snap is: volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.1b192b33-634c-4e58-90ff-e4b2cd00edfb {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:05:22 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9f016b-9013-4084-8fb1-1cfe833d695c]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:05:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-23a75e29-eee5-4c8e-b15c-cfd2d8727ab5 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.1b192b33-634c-4e58-90ff-e4b2cd00edfb {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:22 devstack sudo[93005]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5dacb561-a004-42c1-81cc-7db4bd71d97f 1073741824" returned: 0 in 1.621s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5dacb561-a004-42c1-81cc-7db4bd71d97f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:22 devstack sudo[93025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.1b192b33-634c-4e58-90ff-e4b2cd00edfb
Jul 03 13:05:22 devstack sudo[93025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:22 devstack sudo[93028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5dacb561-a004-42c1-81cc-7db4bd71d97f
Jul 03 13:05:22 devstack sudo[93028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:22 devstack sudo[93008]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9240215f-c817-4c78-b6e1-3876e2be15e3 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.352s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:22 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-9240215f-c817-4c78-b6e1-3876e2be15e3 tempest-VolumesSnapshotTestJSON-198537084 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:05:22 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-9240215f-c817-4c78-b6e1-3876e2be15e3 tempest-VolumesSnapshotTestJSON-198537084 None] Deleted volume successfully.
Jul 03 13:05:22 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9240215f-c817-4c78-b6e1-3876e2be15e3 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-5f151b82-62d8-4c57-9ba3-9c53098b2807-delete_volume" released by "delete_volume" :: held 5.501s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:23 devstack sudo[93025]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-23a75e29-eee5-4c8e-b15c-cfd2d8727ab5 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.1b192b33-634c-4e58-90ff-e4b2cd00edfb" returned: 0 in 1.287s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-23a75e29-eee5-4c8e-b15c-cfd2d8727ab5 tempest-VolumesSnapshotTestJSON-198537084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:05:23 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5348c8-0bf7-4963-a880-f0ad12643a18]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:05:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-23a75e29-eee5-4c8e-b15c-cfd2d8727ab5 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5dacb561-a004-42c1-81cc-7db4bd71d97f" returned: 0 in 1.251s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] <== create_volume: return (3005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:05:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.023s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:23 devstack sudo[93028]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a4bb91-edbe-4142-b076-83f3da87380a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dacb561-a004-42c1-81cc-7db4bd71d97f', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:23 devstack sudo[93035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315
Jul 03 13:05:23 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b35c24ea-0894-4f11-94f0-d66f51fcee22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:23 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Volume volume-5dacb561-a004-42c1-81cc-7db4bd71d97f (5dacb561-a004-42c1-81cc-7db4bd71d97f): created successfully
Jul 03 13:05:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b35c24ea-0894-4f11-94f0-d66f51fcee22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Flow 'volume_create_manager' (0ab4944f-635b-416a-af1e-8e4d0dd40fa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:05:23 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-1da42c19-327e-43dc-b3ba-15e08b220c0e tempest-ServerRescueNegativeTestJSON-917087968 None] Created volume successfully.
Jul 03 13:05:24 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-23a75e29-eee5-4c8e-b15c-cfd2d8727ab5 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315" returned: 0 in 1.280s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-23a75e29-eee5-4c8e-b15c-cfd2d8727ab5 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.1b192b33-634c-4e58-90ff-e4b2cd00edfb {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:24 devstack sudo[93040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.1b192b33-634c-4e58-90ff-e4b2cd00edfb
Jul 03 13:05:24 devstack sudo[93040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-b37fd547-e933-4c03-9a3f-d2e509c3fac4 req-17865623-e2b0-433b-b82c-695d472285ab tempest-AttachVolumeNegativeTest-2100265475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-b37fd547-e933-4c03-9a3f-d2e509c3fac4 req-17865623-e2b0-433b-b82c-695d472285ab tempest-AttachVolumeNegativeTest-2100265475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:25 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfb636b-238f-4926-95a5-d9dcfc9780b2]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:05:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-b37fd547-e933-4c03-9a3f-d2e509c3fac4 req-17865623-e2b0-433b-b82c-695d472285ab tempest-AttachVolumeNegativeTest-2100265475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-80139456-8151-471c-a915-1508343f25d9 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:26 devstack sudo[93056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-80139456-8151-471c-a915-1508343f25d9
Jul 03 13:05:26 devstack sudo[93056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:26 devstack sudo[93040]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-23a75e29-eee5-4c8e-b15c-cfd2d8727ab5 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.1b192b33-634c-4e58-90ff-e4b2cd00edfb" returned: 0 in 1.544s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-23a75e29-eee5-4c8e-b15c-cfd2d8727ab5 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.1b192b33-634c-4e58-90ff-e4b2cd00edfb {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:26 devstack sudo[93058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.1b192b33-634c-4e58-90ff-e4b2cd00edfb
Jul 03 13:05:26 devstack sudo[93058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:27 devstack sudo[93056]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-b37fd547-e933-4c03-9a3f-d2e509c3fac4 req-17865623-e2b0-433b-b82c-695d472285ab tempest-AttachVolumeNegativeTest-2100265475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-80139456-8151-471c-a915-1508343f25d9" returned: 0 in 1.557s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-b37fd547-e933-4c03-9a3f-d2e509c3fac4 req-17865623-e2b0-433b-b82c-695d472285ab tempest-AttachVolumeNegativeTest-2100265475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.583s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:27 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-b37fd547-e933-4c03-9a3f-d2e509c3fac4 req-17865623-e2b0-433b-b82c-695d472285ab tempest-AttachVolumeNegativeTest-2100265475 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db', 'name': 'volume-80139456-8151-471c-a915-1508343f25d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2aed2979-7c63-4326-938b-2dc49bde8f2d', 'enforce_multipath': True} {{(pid=86837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 13:05:27 devstack sudo[93058]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:27 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-b37fd547-e933-4c03-9a3f-d2e509c3fac4 req-17865623-e2b0-433b-b82c-695d472285ab tempest-AttachVolumeNegativeTest-2100265475 None] attachment_update completed successfully.
Jul 03 13:05:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-23a75e29-eee5-4c8e-b15c-cfd2d8727ab5 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315.1b192b33-634c-4e58-90ff-e4b2cd00edfb" returned: 0 in 1.459s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:27 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-23a75e29-eee5-4c8e-b15c-cfd2d8727ab5 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-1b192b33-634c-4e58-90ff-e4b2cd00edfb" released by "_delete_snapshot" :: held 5.721s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:27 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-23a75e29-eee5-4c8e-b15c-cfd2d8727ab5 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-6a188980-f6a1-48da-b1e6-c02c4c8dc315" released by "delete_snapshot" :: held 5.785s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:27 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-23a75e29-eee5-4c8e-b15c-cfd2d8727ab5 tempest-VolumesSnapshotTestJSON-198537084 None] Created reservations ['e5a1b4b5-aa25-4fe4-b9f7-5d49e9876311', 'c87d5717-c62b-4db1-a8ff-4240fb7af3b0', '57388124-f774-419a-8ce4-1824c756dd06', '94337645-4fbd-4117-9741-2c9488639d34'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:05:27 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-23a75e29-eee5-4c8e-b15c-cfd2d8727ab5 tempest-VolumesSnapshotTestJSON-198537084 None] Delete snapshot completed successfully.
Jul 03 13:05:27 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-23a75e29-eee5-4c8e-b15c-cfd2d8727ab5 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-1b192b33-634c-4e58-90ff-e4b2cd00edfb-delete_snapshot" released by "delete_snapshot" :: held 6.025s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:28 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4c4da1d0-9531-465f-a559-44bcce94c668 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "cinder-6a188980-f6a1-48da-b1e6-c02c4c8dc315-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:28 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4c4da1d0-9531-465f-a559-44bcce94c668 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-6a188980-f6a1-48da-b1e6-c02c4c8dc315-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:28 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4c4da1d0-9531-465f-a559-44bcce94c668 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "cinder-quobyte-6a188980-f6a1-48da-b1e6-c02c4c8dc315" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:28 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4c4da1d0-9531-465f-a559-44bcce94c668 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-6a188980-f6a1-48da-b1e6-c02c4c8dc315" acquired by "delete_volume" :: waited 0.026s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:28 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[1beac1e5-e4f8-4ba6-8b4e-f92a2ed95ae2]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:05:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4c4da1d0-9531-465f-a559-44bcce94c668 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:29 devstack sudo[93446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315
Jul 03 13:05:29 devstack sudo[93446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:30 devstack sudo[93446]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4c4da1d0-9531-465f-a559-44bcce94c668 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315" returned: 0 in 1.291s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4c4da1d0-9531-465f-a559-44bcce94c668 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:30 devstack sudo[93485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315
Jul 03 13:05:30 devstack sudo[93485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4c4da1d0-9531-465f-a559-44bcce94c668 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a188980-f6a1-48da-b1e6-c02c4c8dc315" returned: 0 in 1.001s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:31 devstack sudo[93485]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:31 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4c4da1d0-9531-465f-a559-44bcce94c668 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-6a188980-f6a1-48da-b1e6-c02c4c8dc315" released by "delete_volume" :: held 2.515s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:31 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-4c4da1d0-9531-465f-a559-44bcce94c668 tempest-VolumesSnapshotTestJSON-198537084 None] Created reservations ['1ba5fdcc-4abb-454e-84ee-b969516b427f', '8c494018-73a4-4d5a-b224-bd2e64fd0e7c', '13a99d23-9cf9-40a7-98d2-63e28b15ee34', 'e728dd90-f221-460c-a663-3f7312585784'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:05:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4c4da1d0-9531-465f-a559-44bcce94c668 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4c4da1d0-9531-465f-a559-44bcce94c668 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4c4da1d0-9531-465f-a559-44bcce94c668 tempest-VolumesSnapshotTestJSON-198537084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:05:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4c4da1d0-9531-465f-a559-44bcce94c668 tempest-VolumesSnapshotTestJSON-198537084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:05:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4c4da1d0-9531-465f-a559-44bcce94c668 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4c4da1d0-9531-465f-a559-44bcce94c668 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:31 devstack sudo[93519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:05:31 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:32 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3d19aef3-9cf2-4f90-82a7-71785a97e645 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "cinder-6a0ceba6-5f4d-4e11-8f6e-695e9a661455-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:32 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3d19aef3-9cf2-4f90-82a7-71785a97e645 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-6a0ceba6-5f4d-4e11-8f6e-695e9a661455-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:32 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3d19aef3-9cf2-4f90-82a7-71785a97e645 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "cinder-quobyte-6a0ceba6-5f4d-4e11-8f6e-695e9a661455" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:32 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3d19aef3-9cf2-4f90-82a7-71785a97e645 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-6a0ceba6-5f4d-4e11-8f6e-695e9a661455" acquired by "delete_volume" :: waited 0.032s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:32 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f75e56-f203-442e-8e54-0bef909ed56a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:05:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3d19aef3-9cf2-4f90-82a7-71785a97e645 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:33 devstack sudo[93522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455
Jul 03 13:05:33 devstack sudo[93522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:33 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4c4da1d0-9531-465f-a559-44bcce94c668 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.269s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:33 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-4c4da1d0-9531-465f-a559-44bcce94c668 tempest-VolumesSnapshotTestJSON-198537084 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:05:33 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-4c4da1d0-9531-465f-a559-44bcce94c668 tempest-VolumesSnapshotTestJSON-198537084 None] Deleted volume successfully.
Jul 03 13:05:33 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4c4da1d0-9531-465f-a559-44bcce94c668 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-6a188980-f6a1-48da-b1e6-c02c4c8dc315-delete_volume" released by "delete_volume" :: held 4.445s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:34 devstack sudo[93522]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3d19aef3-9cf2-4f90-82a7-71785a97e645 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455" returned: 0 in 1.508s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3d19aef3-9cf2-4f90-82a7-71785a97e645 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:34 devstack sudo[93532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455
Jul 03 13:05:34 devstack sudo[93532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:35 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-be793250-171c-4d16-9218-b03630e22bca req-8b23928b-ad7e-44e1-960e-e51810ea7728 tempest-AttachVolumeNegativeTest-2100265475 None] Terminate volume connection completed successfully.
Jul 03 13:05:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-be793250-171c-4d16-9218-b03630e22bca req-8b23928b-ad7e-44e1-960e-e51810ea7728 tempest-AttachVolumeNegativeTest-2100265475 None] Deleting attachment 2aed2979-7c63-4326-938b-2dc49bde8f2d. {{(pid=86837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:05:35 devstack sudo[93532]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3d19aef3-9cf2-4f90-82a7-71785a97e645 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6a0ceba6-5f4d-4e11-8f6e-695e9a661455" returned: 0 in 1.326s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:35 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3d19aef3-9cf2-4f90-82a7-71785a97e645 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-quobyte-6a0ceba6-5f4d-4e11-8f6e-695e9a661455" released by "delete_volume" :: held 2.965s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:35 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-3d19aef3-9cf2-4f90-82a7-71785a97e645 tempest-VolumesSnapshotTestJSON-198537084 None] Created reservations ['8f87419a-e3a6-4f72-8b07-113c99d61ac9', 'd925ac95-1ad7-49a3-abe6-d9505becee14', '67606a8d-2fd8-47fb-be9a-da1cb9e49595', '608bc119-cc25-4fd7-9d83-263b51d91dc1'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:05:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3d19aef3-9cf2-4f90-82a7-71785a97e645 tempest-VolumesSnapshotTestJSON-198537084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3d19aef3-9cf2-4f90-82a7-71785a97e645 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3d19aef3-9cf2-4f90-82a7-71785a97e645 tempest-VolumesSnapshotTestJSON-198537084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:05:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3d19aef3-9cf2-4f90-82a7-71785a97e645 tempest-VolumesSnapshotTestJSON-198537084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:05:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3d19aef3-9cf2-4f90-82a7-71785a97e645 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3d19aef3-9cf2-4f90-82a7-71785a97e645 tempest-VolumesSnapshotTestJSON-198537084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:36 devstack sudo[93601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:05:36 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:37 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3d19aef3-9cf2-4f90-82a7-71785a97e645 tempest-VolumesSnapshotTestJSON-198537084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.561s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:37 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-3d19aef3-9cf2-4f90-82a7-71785a97e645 tempest-VolumesSnapshotTestJSON-198537084 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:05:37 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-3d19aef3-9cf2-4f90-82a7-71785a97e645 tempest-VolumesSnapshotTestJSON-198537084 None] Deleted volume successfully.
Jul 03 13:05:37 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3d19aef3-9cf2-4f90-82a7-71785a97e645 tempest-VolumesSnapshotTestJSON-198537084 None] Lock "cinder-6a0ceba6-5f4d-4e11-8f6e-695e9a661455-delete_volume" released by "delete_volume" :: held 5.140s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:05:45 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=34,cinder:UPDATE=33,cinder:INSERT=12,cinder:DELETE=4 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:05:47 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:UPDATE=44,cinder:SELECT=29,cinder:DELETE=2,cinder:INSERT=6 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:05:53 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:05:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Flow 'volume_create_manager' (313a55fc-14df-4bda-9d53-44d06eb10ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:05:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04ce566-fc49-4b60-acf8-c4eb4ae3ca41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04ce566-fc49-4b60-acf8-c4eb4ae3ca41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2024811391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b86a96-1457-47c7-a689-6726e595e789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0f760d24d14b148a42424eb2d4dc85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:53Z,use_quota=True,user_id='7a55f8481ab94892933c584ff91d3d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baa91ac6-c38b-42c4-8492-43bbdd916d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baa91ac6-c38b-42c4-8492-43bbdd916d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a07b7c16-0e94-4176-a59d-c651a9a08329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a07b7c16-0e94-4176-a59d-c651a9a08329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72b86a96-1457-47c7-a689-6726e595e789', 'volume_name': 'volume-72b86a96-1457-47c7-a689-6726e595e789', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807ca114-659e-4379-8a01-9054bfe73865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807ca114-659e-4379-8a01-9054bfe73865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1acdff3d-35f8-4402-b273-d97d45e3d379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:53 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Volume 72b86a96-1457-47c7-a689-6726e595e789: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72b86a96-1457-47c7-a689-6726e595e789', 'volume_size': 1}
Jul 03 13:05:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:53 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2024811391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b86a96-1457-47c7-a689-6726e595e789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0f760d24d14b148a42424eb2d4dc85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:05:53Z,use_quota=True,user_id='7a55f8481ab94892933c584ff91d3d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:05:53 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Creating volume 72b86a96-1457-47c7-a689-6726e595e789 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:05:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:53 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:05:53 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:05:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:53 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:05:53 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:05:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:53 devstack sudo[93762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789 1073741824
Jul 03 13:05:53 devstack sudo[93762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:55 devstack sudo[93762]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789 1073741824" returned: 0 in 2.017s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:55 devstack sudo[93769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789
Jul 03 13:05:55 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:56 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789" returned: 0 in 0.919s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] <== create_volume: return (3030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:05:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.033s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:05:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1acdff3d-35f8-4402-b273-d97d45e3d379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b86a96-1457-47c7-a689-6726e595e789', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef7e585-1acb-45f7-b4f1-8f9da0649136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:05:56 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Volume volume-72b86a96-1457-47c7-a689-6726e595e789 (72b86a96-1457-47c7-a689-6726e595e789): created successfully
Jul 03 13:05:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef7e585-1acb-45f7-b4f1-8f9da0649136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:05:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Flow 'volume_create_manager' (313a55fc-14df-4bda-9d53-44d06eb10ce0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:05:56 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-ebfcae0a-637a-42a2-8c8f-6857dda74d32 tempest-VolumesSnapshotListTestJSON-1562632331 None] Created volume successfully.
Jul 03 13:05:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4d2bf193-ca59-4f2e-a5e4-c7944c40751e tempest-VolumesSnapshotListTestJSON-1562632331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:05:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4d2bf193-ca59-4f2e-a5e4-c7944c40751e tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:05:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-4d2bf193-ca59-4f2e-a5e4-c7944c40751e tempest-VolumesSnapshotListTestJSON-1562632331 None] Creating offline snapshot affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c of volume 72b86a96-1457-47c7-a689-6726e595e789 {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:05:58 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[046ba85d-4451-497e-8681-21b6e9d3a659]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:05:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4d2bf193-ca59-4f2e-a5e4-c7944c40751e tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:58 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6be1bfbc-f34e-454e-9c18-abefb3127240 tempest-ServerRescueNegativeTestJSON-917087968 None] Acquiring lock "cinder-5dacb561-a004-42c1-81cc-7db4bd71d97f-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:58 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6be1bfbc-f34e-454e-9c18-abefb3127240 tempest-ServerRescueNegativeTestJSON-917087968 None] Lock "cinder-5dacb561-a004-42c1-81cc-7db4bd71d97f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:58 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6be1bfbc-f34e-454e-9c18-abefb3127240 tempest-ServerRescueNegativeTestJSON-917087968 None] Acquiring lock "cinder-quobyte-5dacb561-a004-42c1-81cc-7db4bd71d97f" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:05:58 devstack sudo[93773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789
Jul 03 13:05:58 devstack sudo[93773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:58 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6be1bfbc-f34e-454e-9c18-abefb3127240 tempest-ServerRescueNegativeTestJSON-917087968 None] Lock "cinder-quobyte-5dacb561-a004-42c1-81cc-7db4bd71d97f" acquired by "delete_volume" :: waited 0.029s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:05:58 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d45fd1-e214-4878-a2f4-a23fbc471b5d]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:05:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6be1bfbc-f34e-454e-9c18-abefb3127240 tempest-ServerRescueNegativeTestJSON-917087968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5dacb561-a004-42c1-81cc-7db4bd71d97f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:58 devstack sudo[93775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5dacb561-a004-42c1-81cc-7db4bd71d97f
Jul 03 13:05:58 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:05:59 devstack sudo[93773]: pam_unix(sudo:session): session closed for user root
Jul 03 13:05:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4d2bf193-ca59-4f2e-a5e4-c7944c40751e tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789" returned: 0 in 1.705s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:05:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4d2bf193-ca59-4f2e-a5e4-c7944c40751e tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:05:59 devstack sudo[93780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c 1G
Jul 03 13:05:59 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:00 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6be1bfbc-f34e-454e-9c18-abefb3127240 tempest-ServerRescueNegativeTestJSON-917087968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5dacb561-a004-42c1-81cc-7db4bd71d97f" returned: 0 in 2.231s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6be1bfbc-f34e-454e-9c18-abefb3127240 tempest-ServerRescueNegativeTestJSON-917087968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5dacb561-a004-42c1-81cc-7db4bd71d97f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:00 devstack sudo[93790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5dacb561-a004-42c1-81cc-7db4bd71d97f
Jul 03 13:06:00 devstack sudo[93790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:02 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4d2bf193-ca59-4f2e-a5e4-c7944c40751e tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c 1G" returned: 0 in 2.196s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4d2bf193-ca59-4f2e-a5e4-c7944c40751e tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b86a96-1457-47c7-a689-6726e595e789 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:02 devstack sudo[93795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b86a96-1457-47c7-a689-6726e595e789 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c
Jul 03 13:06:02 devstack sudo[93795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:02 devstack sudo[93790]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6be1bfbc-f34e-454e-9c18-abefb3127240 tempest-ServerRescueNegativeTestJSON-917087968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5dacb561-a004-42c1-81cc-7db4bd71d97f" returned: 0 in 2.053s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:02 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6be1bfbc-f34e-454e-9c18-abefb3127240 tempest-ServerRescueNegativeTestJSON-917087968 None] Lock "cinder-quobyte-5dacb561-a004-42c1-81cc-7db4bd71d97f" released by "delete_volume" :: held 4.367s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:02 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-6be1bfbc-f34e-454e-9c18-abefb3127240 tempest-ServerRescueNegativeTestJSON-917087968 None] Created reservations ['e2a37d57-780c-4ded-8b84-9929afe28eac', '00306f39-a92c-4235-9c05-44db575ac88d', '88a68820-376b-4884-b988-16be1c8387cd', 'f79ce042-d852-4863-8b1c-6e4fd6eb86f3'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:06:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6be1bfbc-f34e-454e-9c18-abefb3127240 tempest-ServerRescueNegativeTestJSON-917087968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:06:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6be1bfbc-f34e-454e-9c18-abefb3127240 tempest-ServerRescueNegativeTestJSON-917087968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:06:03 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6be1bfbc-f34e-454e-9c18-abefb3127240 tempest-ServerRescueNegativeTestJSON-917087968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:06:03 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6be1bfbc-f34e-454e-9c18-abefb3127240 tempest-ServerRescueNegativeTestJSON-917087968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:06:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6be1bfbc-f34e-454e-9c18-abefb3127240 tempest-ServerRescueNegativeTestJSON-917087968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6be1bfbc-f34e-454e-9c18-abefb3127240 tempest-ServerRescueNegativeTestJSON-917087968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:03 devstack sudo[93804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:06:03 devstack sudo[93804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:03 devstack sudo[93795]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4d2bf193-ca59-4f2e-a5e4-c7944c40751e tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b86a96-1457-47c7-a689-6726e595e789 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c" returned: 0 in 1.470s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:03 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-4d2bf193-ca59-4f2e-a5e4-c7944c40751e tempest-VolumesSnapshotListTestJSON-1562632331 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c is being set with open permissions: ugo+rw
Jul 03 13:06:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4d2bf193-ca59-4f2e-a5e4-c7944c40751e tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:03 devstack sudo[93806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c
Jul 03 13:06:03 devstack sudo[93806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:04 devstack sudo[93804]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6be1bfbc-f34e-454e-9c18-abefb3127240 tempest-ServerRescueNegativeTestJSON-917087968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.558s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:04 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-6be1bfbc-f34e-454e-9c18-abefb3127240 tempest-ServerRescueNegativeTestJSON-917087968 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:06:04 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-6be1bfbc-f34e-454e-9c18-abefb3127240 tempest-ServerRescueNegativeTestJSON-917087968 None] Deleted volume successfully.
Jul 03 13:06:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6be1bfbc-f34e-454e-9c18-abefb3127240 tempest-ServerRescueNegativeTestJSON-917087968 None] Lock "cinder-5dacb561-a004-42c1-81cc-7db4bd71d97f-delete_volume" released by "delete_volume" :: held 6.562s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:05 devstack sudo[93806]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4d2bf193-ca59-4f2e-a5e4-c7944c40751e tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c" returned: 0 in 2.026s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4d2bf193-ca59-4f2e-a5e4-c7944c40751e tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:05 devstack sudo[93842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.info
Jul 03 13:06:05 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:06 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4d2bf193-ca59-4f2e-a5e4-c7944c40751e tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.info" returned: 0 in 1.245s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:06 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-4d2bf193-ca59-4f2e-a5e4-c7944c40751e tempest-VolumesSnapshotListTestJSON-1562632331 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.info is being set with open permissions: ugo+rw
Jul 03 13:06:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4d2bf193-ca59-4f2e-a5e4-c7944c40751e tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:06 devstack sudo[93852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.info
Jul 03 13:06:06 devstack sudo[93852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:08 devstack sudo[93852]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4d2bf193-ca59-4f2e-a5e4-c7944c40751e tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.info" returned: 0 in 1.149s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4d2bf193-ca59-4f2e-a5e4-c7944c40751e tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 10.034s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:08 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-4d2bf193-ca59-4f2e-a5e4-c7944c40751e tempest-VolumesSnapshotListTestJSON-1562632331 None] Create snapshot completed successfully
Jul 03 13:06:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-62796fc2-2b4d-433d-b881-6fbc7bfbb5d6 tempest-VolumesSnapshotListTestJSON-1562632331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:06:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-62796fc2-2b4d-433d-b881-6fbc7bfbb5d6 tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:06:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-62796fc2-2b4d-433d-b881-6fbc7bfbb5d6 tempest-VolumesSnapshotListTestJSON-1562632331 None] Creating offline snapshot ae25858a-18f7-4050-9ee8-b9aeefefdd8d of volume 72b86a96-1457-47c7-a689-6726e595e789 {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:06:09 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe105de-583c-47e0-b1a0-029956d4d8c3]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:06:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-62796fc2-2b4d-433d-b881-6fbc7bfbb5d6 tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:09 devstack sudo[93867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c
Jul 03 13:06:09 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:10 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-62796fc2-2b4d-433d-b881-6fbc7bfbb5d6 tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c" returned: 0 in 1.294s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:10 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-62796fc2-2b4d-433d-b881-6fbc7bfbb5d6 tempest-VolumesSnapshotListTestJSON-1562632331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b86a96-1457-47c7-a689-6726e595e789(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:06:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-62796fc2-2b4d-433d-b881-6fbc7bfbb5d6 tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:10 devstack sudo[93879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d 1G
Jul 03 13:06:10 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:12 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-62796fc2-2b4d-433d-b881-6fbc7bfbb5d6 tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d 1G" returned: 0 in 1.385s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-62796fc2-2b4d-433d-b881-6fbc7bfbb5d6 tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:12 devstack sudo[93887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d
Jul 03 13:06:12 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:13 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-62796fc2-2b4d-433d-b881-6fbc7bfbb5d6 tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d" returned: 0 in 1.535s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:13 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-62796fc2-2b4d-433d-b881-6fbc7bfbb5d6 tempest-VolumesSnapshotListTestJSON-1562632331 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d is being set with open permissions: ugo+rw
Jul 03 13:06:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-62796fc2-2b4d-433d-b881-6fbc7bfbb5d6 tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:13 devstack sudo[93931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d
Jul 03 13:06:13 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:14 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-62796fc2-2b4d-433d-b881-6fbc7bfbb5d6 tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d" returned: 0 in 1.078s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-62796fc2-2b4d-433d-b881-6fbc7bfbb5d6 tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.538s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:14 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-62796fc2-2b4d-433d-b881-6fbc7bfbb5d6 tempest-VolumesSnapshotListTestJSON-1562632331 None] Create snapshot completed successfully
Jul 03 13:06:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:06:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:06:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:06:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:06:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:06:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:14 devstack sudo[93971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:06:14 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:16 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.100s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:16 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:06:16 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:06:16 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 8 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:06:16 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:06:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8fe600aa-c1dc-4ea9-9cd1-b13063f08efd tempest-VolumesSnapshotListTestJSON-1562632331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:06:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8fe600aa-c1dc-4ea9-9cd1-b13063f08efd tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:06:16 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-8fe600aa-c1dc-4ea9-9cd1-b13063f08efd tempest-VolumesSnapshotListTestJSON-1562632331 None] Creating offline snapshot 1abef981-816d-4567-b865-e513bb4ec964 of volume 72b86a96-1457-47c7-a689-6726e595e789 {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:06:16 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b76399f-a7c2-432d-93c3-350c41aa7db9]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:06:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8fe600aa-c1dc-4ea9-9cd1-b13063f08efd tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:16 devstack sudo[93982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d
Jul 03 13:06:16 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:17 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8fe600aa-c1dc-4ea9-9cd1-b13063f08efd tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d" returned: 0 in 0.987s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:17 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-8fe600aa-c1dc-4ea9-9cd1-b13063f08efd tempest-VolumesSnapshotListTestJSON-1562632331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b86a96-1457-47c7-a689-6726e595e789(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:06:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8fe600aa-c1dc-4ea9-9cd1-b13063f08efd tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.1abef981-816d-4567-b865-e513bb4ec964 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:17 devstack sudo[93988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.1abef981-816d-4567-b865-e513bb4ec964 1G
Jul 03 13:06:17 devstack sudo[93988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:19 devstack sudo[93988]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8fe600aa-c1dc-4ea9-9cd1-b13063f08efd tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.1abef981-816d-4567-b865-e513bb4ec964 1G" returned: 0 in 1.939s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8fe600aa-c1dc-4ea9-9cd1-b13063f08efd tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.1abef981-816d-4567-b865-e513bb4ec964 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:19 devstack sudo[94074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.1abef981-816d-4567-b865-e513bb4ec964
Jul 03 13:06:19 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:20 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8fe600aa-c1dc-4ea9-9cd1-b13063f08efd tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.1abef981-816d-4567-b865-e513bb4ec964" returned: 0 in 1.229s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:20 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-8fe600aa-c1dc-4ea9-9cd1-b13063f08efd tempest-VolumesSnapshotListTestJSON-1562632331 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.1abef981-816d-4567-b865-e513bb4ec964 is being set with open permissions: ugo+rw
Jul 03 13:06:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8fe600aa-c1dc-4ea9-9cd1-b13063f08efd tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.1abef981-816d-4567-b865-e513bb4ec964 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:20 devstack sudo[94082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.1abef981-816d-4567-b865-e513bb4ec964
Jul 03 13:06:20 devstack sudo[94082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8fe600aa-c1dc-4ea9-9cd1-b13063f08efd tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.1abef981-816d-4567-b865-e513bb4ec964" returned: 0 in 1.060s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:21 devstack sudo[94082]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8fe600aa-c1dc-4ea9-9cd1-b13063f08efd tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.596s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:21 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-8fe600aa-c1dc-4ea9-9cd1-b13063f08efd tempest-VolumesSnapshotListTestJSON-1562632331 None] Create snapshot completed successfully
Jul 03 13:06:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ae114f48-8419-440a-983b-0e48f4c43f25 tempest-VolumesSnapshotListTestJSON-1562632331 None] Acquiring lock "cinder-1abef981-816d-4567-b865-e513bb4ec964-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ae114f48-8419-440a-983b-0e48f4c43f25 tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "cinder-1abef981-816d-4567-b865-e513bb4ec964-delete_snapshot" acquired by "delete_snapshot" :: waited 0.115s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ae114f48-8419-440a-983b-0e48f4c43f25 tempest-VolumesSnapshotListTestJSON-1562632331 None] Acquiring lock "cinder-quobyte-72b86a96-1457-47c7-a689-6726e595e789" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ae114f48-8419-440a-983b-0e48f4c43f25 tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "cinder-quobyte-72b86a96-1457-47c7-a689-6726e595e789" acquired by "delete_snapshot" :: waited 0.067s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ae114f48-8419-440a-983b-0e48f4c43f25 tempest-VolumesSnapshotListTestJSON-1562632331 None] Acquiring lock "cinder-quobyte-1abef981-816d-4567-b865-e513bb4ec964" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ae114f48-8419-440a-983b-0e48f4c43f25 tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "cinder-quobyte-1abef981-816d-4567-b865-e513bb4ec964" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-ae114f48-8419-440a-983b-0e48f4c43f25 tempest-VolumesSnapshotListTestJSON-1562632331 None] Deleting offline snapshot 1abef981-816d-4567-b865-e513bb4ec964 of volume 72b86a96-1457-47c7-a689-6726e595e789 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:06:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-ae114f48-8419-440a-983b-0e48f4c43f25 tempest-VolumesSnapshotListTestJSON-1562632331 None] snapshot_file for this snap is: volume-72b86a96-1457-47c7-a689-6726e595e789.1abef981-816d-4567-b865-e513bb4ec964 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:06:25 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdb244f-d797-4f6b-9304-979db2559ace]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:06:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ae114f48-8419-440a-983b-0e48f4c43f25 tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.1abef981-816d-4567-b865-e513bb4ec964 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:25 devstack sudo[94160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.1abef981-816d-4567-b865-e513bb4ec964
Jul 03 13:06:25 devstack sudo[94160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:27 devstack sudo[94160]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ae114f48-8419-440a-983b-0e48f4c43f25 tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.1abef981-816d-4567-b865-e513bb4ec964" returned: 0 in 1.981s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:27 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-ae114f48-8419-440a-983b-0e48f4c43f25 tempest-VolumesSnapshotListTestJSON-1562632331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b86a96-1457-47c7-a689-6726e595e789(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:06:27 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0dac63-5f70-4657-a021-6e3e1503deae]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:06:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ae114f48-8419-440a-983b-0e48f4c43f25 tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:27 devstack sudo[94171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d
Jul 03 13:06:27 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:28 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ae114f48-8419-440a-983b-0e48f4c43f25 tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d" returned: 0 in 1.638s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:28 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-ae114f48-8419-440a-983b-0e48f4c43f25 tempest-VolumesSnapshotListTestJSON-1562632331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b86a96-1457-47c7-a689-6726e595e789(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:06:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ae114f48-8419-440a-983b-0e48f4c43f25 tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.1abef981-816d-4567-b865-e513bb4ec964 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:28 devstack sudo[94177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.1abef981-816d-4567-b865-e513bb4ec964
Jul 03 13:06:28 devstack sudo[94177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:30 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:06:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Flow 'volume_create_manager' (819d7725-3649-4bea-a8eb-ed5e0a71d0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:06:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc331a0-9743-452d-a1ad-13cc863eedcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc331a0-9743-452d-a1ad-13cc863eedcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1078436938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82500d49-c22e-49ce-b73b-f46601188932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eecb317dca44a9a84c1fa43171306c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:31Z,use_quota=True,user_id='9e6e3c1ebb654d97bfc019c6ec7a4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c2672b0-9677-4d08-838c-70fa7a1c5827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c2672b0-9677-4d08-838c-70fa7a1c5827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc7e265-1860-4d49-acd6-8779db3161cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc7e265-1860-4d49-acd6-8779db3161cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82500d49-c22e-49ce-b73b-f46601188932', 'volume_name': 'volume-82500d49-c22e-49ce-b73b-f46601188932', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51002539-d928-4fa1-b2bb-222ab4896552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51002539-d928-4fa1-b2bb-222ab4896552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abafed2d-07d5-4151-b071-d0e490133e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:31 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Volume 82500d49-c22e-49ce-b73b-f46601188932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82500d49-c22e-49ce-b73b-f46601188932', 'volume_size': 1}
Jul 03 13:06:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:06:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:06:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1078436938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82500d49-c22e-49ce-b73b-f46601188932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eecb317dca44a9a84c1fa43171306c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:31Z,use_quota=True,user_id='9e6e3c1ebb654d97bfc019c6ec7a4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:06:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Creating volume 82500d49-c22e-49ce-b73b-f46601188932 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:06:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:06:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:06:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:06:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:06:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:06:31 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:06:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-82500d49-c22e-49ce-b73b-f46601188932 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:31 devstack sudo[94184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-82500d49-c22e-49ce-b73b-f46601188932 1073741824
Jul 03 13:06:31 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:31 devstack sudo[94177]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ae114f48-8419-440a-983b-0e48f4c43f25 tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.1abef981-816d-4567-b865-e513bb4ec964" returned: 0 in 2.406s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ae114f48-8419-440a-983b-0e48f4c43f25 tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.1abef981-816d-4567-b865-e513bb4ec964 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:31 devstack sudo[94186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.1abef981-816d-4567-b865-e513bb4ec964
Jul 03 13:06:31 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:32 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-82500d49-c22e-49ce-b73b-f46601188932 1073741824" returned: 0 in 1.491s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-82500d49-c22e-49ce-b73b-f46601188932 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:32 devstack sudo[94193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-82500d49-c22e-49ce-b73b-f46601188932
Jul 03 13:06:32 devstack sudo[94193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:33 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ae114f48-8419-440a-983b-0e48f4c43f25 tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.1abef981-816d-4567-b865-e513bb4ec964" returned: 0 in 2.044s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:33 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ae114f48-8419-440a-983b-0e48f4c43f25 tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "cinder-quobyte-1abef981-816d-4567-b865-e513bb4ec964" released by "_delete_snapshot" :: held 8.376s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:33 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ae114f48-8419-440a-983b-0e48f4c43f25 tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "cinder-quobyte-72b86a96-1457-47c7-a689-6726e595e789" released by "delete_snapshot" :: held 8.435s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:33 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-ae114f48-8419-440a-983b-0e48f4c43f25 tempest-VolumesSnapshotListTestJSON-1562632331 None] Created reservations ['1aa9a129-4694-40c9-8583-c5dca879d79d', 'a0ab32b7-7be3-43ea-a007-89bbec223f17', '248d430d-4b06-4795-931d-45245633dfd2', 'dde1eff6-5416-4ef4-90ff-41c16082b7c1'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:06:33 devstack sudo[94193]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-82500d49-c22e-49ce-b73b-f46601188932" returned: 0 in 1.039s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:33 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] <== create_volume: return (2620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:06:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.625s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:33 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-ae114f48-8419-440a-983b-0e48f4c43f25 tempest-VolumesSnapshotListTestJSON-1562632331 None] Delete snapshot completed successfully.
Jul 03 13:06:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abafed2d-07d5-4151-b071-d0e490133e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82500d49-c22e-49ce-b73b-f46601188932', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1072114-38cd-416a-8242-0e713ecd6bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:33 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ae114f48-8419-440a-983b-0e48f4c43f25 tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "cinder-1abef981-816d-4567-b865-e513bb4ec964-delete_snapshot" released by "delete_snapshot" :: held 8.849s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:33 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Volume volume-82500d49-c22e-49ce-b73b-f46601188932 (82500d49-c22e-49ce-b73b-f46601188932): created successfully
Jul 03 13:06:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1072114-38cd-416a-8242-0e713ecd6bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Flow 'volume_create_manager' (819d7725-3649-4bea-a8eb-ed5e0a71d0d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:06:33 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-bac269a6-af34-48aa-95fe-4e6490345a38 tempest-VolumesActionsTest-907624772 None] Created volume successfully.
Jul 03 13:06:33 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1fde61b8-9021-40b3-9228-b7afbe81d0fe tempest-VolumesSnapshotListTestJSON-1562632331 None] Acquiring lock "cinder-ae25858a-18f7-4050-9ee8-b9aeefefdd8d-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:34 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1fde61b8-9021-40b3-9228-b7afbe81d0fe tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "cinder-ae25858a-18f7-4050-9ee8-b9aeefefdd8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:34 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1fde61b8-9021-40b3-9228-b7afbe81d0fe tempest-VolumesSnapshotListTestJSON-1562632331 None] Acquiring lock "cinder-quobyte-72b86a96-1457-47c7-a689-6726e595e789" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:34 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1fde61b8-9021-40b3-9228-b7afbe81d0fe tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "cinder-quobyte-72b86a96-1457-47c7-a689-6726e595e789" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:34 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1fde61b8-9021-40b3-9228-b7afbe81d0fe tempest-VolumesSnapshotListTestJSON-1562632331 None] Acquiring lock "cinder-quobyte-ae25858a-18f7-4050-9ee8-b9aeefefdd8d" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:34 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1fde61b8-9021-40b3-9228-b7afbe81d0fe tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "cinder-quobyte-ae25858a-18f7-4050-9ee8-b9aeefefdd8d" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-1fde61b8-9021-40b3-9228-b7afbe81d0fe tempest-VolumesSnapshotListTestJSON-1562632331 None] Deleting offline snapshot ae25858a-18f7-4050-9ee8-b9aeefefdd8d of volume 72b86a96-1457-47c7-a689-6726e595e789 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:06:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-1fde61b8-9021-40b3-9228-b7afbe81d0fe tempest-VolumesSnapshotListTestJSON-1562632331 None] snapshot_file for this snap is: volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:06:34 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac176f4-1829-46a2-8693-d51137e422cd]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:06:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1fde61b8-9021-40b3-9228-b7afbe81d0fe tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:34 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b2cb8561-3346-478a-965e-227df0a8ab10 tempest-VolumesActionsTest-907624772 None] Acquiring lock "cinder-82500d49-c22e-49ce-b73b-f46601188932" by "attach_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:34 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b2cb8561-3346-478a-965e-227df0a8ab10 tempest-VolumesActionsTest-907624772 None] Lock "cinder-82500d49-c22e-49ce-b73b-f46601188932" acquired by "attach_volume" :: waited 0.030s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:34 devstack sudo[94198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d
Jul 03 13:06:34 devstack sudo[94198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:34 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-b2cb8561-3346-478a-965e-227df0a8ab10 tempest-VolumesActionsTest-907624772 None] Attaching volume 82500d49-c22e-49ce-b73b-f46601188932 to instance 577655ac-5d79-4db0-9155-3d33a1014ca6 at mountpoint /dev/vdb on host None.
Jul 03 13:06:34 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-b2cb8561-3346-478a-965e-227df0a8ab10 tempest-VolumesActionsTest-907624772 None] Attach volume completed successfully.
Jul 03 13:06:34 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b2cb8561-3346-478a-965e-227df0a8ab10 tempest-VolumesActionsTest-907624772 None] Lock "cinder-82500d49-c22e-49ce-b73b-f46601188932" released by "attach_volume" :: held 0.276s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:35 devstack sudo[94198]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1fde61b8-9021-40b3-9228-b7afbe81d0fe tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d" returned: 0 in 1.464s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-1fde61b8-9021-40b3-9228-b7afbe81d0fe tempest-VolumesSnapshotListTestJSON-1562632331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b86a96-1457-47c7-a689-6726e595e789(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:06:35 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[233d1006-f381-4063-ae45-85b790299559]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:06:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1fde61b8-9021-40b3-9228-b7afbe81d0fe tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:35 devstack sudo[94244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c
Jul 03 13:06:35 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:35 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-d5420655-d2c5-4250-8d95-b565c9bc8daf tempest-VolumesActionsTest-559339855 None] Terminate volume connection completed successfully.
Jul 03 13:06:36 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d5420655-d2c5-4250-8d95-b565c9bc8daf tempest-VolumesActionsTest-559339855 None] Acquiring lock "cinder-82500d49-c22e-49ce-b73b-f46601188932-detach_volume" by "detach_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:36 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d5420655-d2c5-4250-8d95-b565c9bc8daf tempest-VolumesActionsTest-559339855 None] Lock "cinder-82500d49-c22e-49ce-b73b-f46601188932-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:36 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-d5420655-d2c5-4250-8d95-b565c9bc8daf tempest-VolumesActionsTest-559339855 None] Detaching volume 82500d49-c22e-49ce-b73b-f46601188932 from instance 577655ac-5d79-4db0-9155-3d33a1014ca6.
Jul 03 13:06:36 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-d5420655-d2c5-4250-8d95-b565c9bc8daf tempest-VolumesActionsTest-559339855 None] Detach volume completed successfully.
Jul 03 13:06:36 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d5420655-d2c5-4250-8d95-b565c9bc8daf tempest-VolumesActionsTest-559339855 None] Lock "cinder-82500d49-c22e-49ce-b73b-f46601188932-detach_volume" released by "detach_volume" :: held 0.129s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:36 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1fde61b8-9021-40b3-9228-b7afbe81d0fe tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c" returned: 0 in 1.279s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-1fde61b8-9021-40b3-9228-b7afbe81d0fe tempest-VolumesSnapshotListTestJSON-1562632331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b86a96-1457-47c7-a689-6726e595e789(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:06:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1fde61b8-9021-40b3-9228-b7afbe81d0fe tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:37 devstack sudo[94249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d
Jul 03 13:06:37 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:37 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5660b5e8-19f4-4a59-a7ee-74637ebd2701 tempest-VolumesActionsTest-907624772 None] Acquiring lock "cinder-82500d49-c22e-49ce-b73b-f46601188932-detach_volume" by "detach_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:37 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5660b5e8-19f4-4a59-a7ee-74637ebd2701 tempest-VolumesActionsTest-907624772 None] Lock "cinder-82500d49-c22e-49ce-b73b-f46601188932-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:37 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-5660b5e8-19f4-4a59-a7ee-74637ebd2701 tempest-VolumesActionsTest-907624772 None] Volume detach called, but volume not attached.
Jul 03 13:06:37 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5660b5e8-19f4-4a59-a7ee-74637ebd2701 tempest-VolumesActionsTest-907624772 None] Lock "cinder-82500d49-c22e-49ce-b73b-f46601188932-detach_volume" released by "detach_volume" :: held 0.033s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:38 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6da8e536-ecad-4bb4-8395-c0fa109e7022 tempest-VolumesActionsTest-907624772 None] Acquiring lock "cinder-82500d49-c22e-49ce-b73b-f46601188932-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:38 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6da8e536-ecad-4bb4-8395-c0fa109e7022 tempest-VolumesActionsTest-907624772 None] Lock "cinder-82500d49-c22e-49ce-b73b-f46601188932-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:38 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6da8e536-ecad-4bb4-8395-c0fa109e7022 tempest-VolumesActionsTest-907624772 None] Acquiring lock "cinder-quobyte-82500d49-c22e-49ce-b73b-f46601188932" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:38 devstack sudo[94249]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1fde61b8-9021-40b3-9228-b7afbe81d0fe tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d" returned: 0 in 1.384s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1fde61b8-9021-40b3-9228-b7afbe81d0fe tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:38 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6da8e536-ecad-4bb4-8395-c0fa109e7022 tempest-VolumesActionsTest-907624772 None] Lock "cinder-quobyte-82500d49-c22e-49ce-b73b-f46601188932" acquired by "delete_volume" :: waited 0.041s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:38 devstack sudo[94255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d
Jul 03 13:06:38 devstack sudo[94255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:38 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39000bd-0c89-465c-adbd-7ad6d3ffc4f7]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:06:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6da8e536-ecad-4bb4-8395-c0fa109e7022 tempest-VolumesActionsTest-907624772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-82500d49-c22e-49ce-b73b-f46601188932 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:38 devstack sudo[94257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-82500d49-c22e-49ce-b73b-f46601188932
Jul 03 13:06:38 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:39 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6da8e536-ecad-4bb4-8395-c0fa109e7022 tempest-VolumesActionsTest-907624772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-82500d49-c22e-49ce-b73b-f46601188932" returned: 0 in 1.175s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6da8e536-ecad-4bb4-8395-c0fa109e7022 tempest-VolumesActionsTest-907624772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-82500d49-c22e-49ce-b73b-f46601188932 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:39 devstack sudo[94263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-82500d49-c22e-49ce-b73b-f46601188932
Jul 03 13:06:39 devstack sudo[94263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:39 devstack sudo[94255]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1fde61b8-9021-40b3-9228-b7afbe81d0fe tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.ae25858a-18f7-4050-9ee8-b9aeefefdd8d" returned: 0 in 1.322s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:39 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1fde61b8-9021-40b3-9228-b7afbe81d0fe tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "cinder-quobyte-ae25858a-18f7-4050-9ee8-b9aeefefdd8d" released by "_delete_snapshot" :: held 5.665s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:39 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1fde61b8-9021-40b3-9228-b7afbe81d0fe tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "cinder-quobyte-72b86a96-1457-47c7-a689-6726e595e789" released by "delete_snapshot" :: held 5.717s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:39 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-1fde61b8-9021-40b3-9228-b7afbe81d0fe tempest-VolumesSnapshotListTestJSON-1562632331 None] Created reservations ['32f9b2c0-e43f-4f64-b1f8-44b614cade55', '8987fada-f783-4abc-85f5-06423b37f1bb', '1540f729-4c8b-4e76-a20c-c3b79b557db9', '84bf7006-6f04-4770-9db9-136b9cc90790'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:06:39 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-1fde61b8-9021-40b3-9228-b7afbe81d0fe tempest-VolumesSnapshotListTestJSON-1562632331 None] Delete snapshot completed successfully.
Jul 03 13:06:39 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1fde61b8-9021-40b3-9228-b7afbe81d0fe tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "cinder-ae25858a-18f7-4050-9ee8-b9aeefefdd8d-delete_snapshot" released by "delete_snapshot" :: held 5.976s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-09bdef99-9ac0-44d4-a2d3-767163e7df26 tempest-VolumesSnapshotListTestJSON-1562632331 None] Acquiring lock "cinder-affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-09bdef99-9ac0-44d4-a2d3-767163e7df26 tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "cinder-affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-09bdef99-9ac0-44d4-a2d3-767163e7df26 tempest-VolumesSnapshotListTestJSON-1562632331 None] Acquiring lock "cinder-quobyte-72b86a96-1457-47c7-a689-6726e595e789" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-09bdef99-9ac0-44d4-a2d3-767163e7df26 tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "cinder-quobyte-72b86a96-1457-47c7-a689-6726e595e789" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-09bdef99-9ac0-44d4-a2d3-767163e7df26 tempest-VolumesSnapshotListTestJSON-1562632331 None] Acquiring lock "cinder-quobyte-affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:40 devstack sudo[94263]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6da8e536-ecad-4bb4-8395-c0fa109e7022 tempest-VolumesActionsTest-907624772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-82500d49-c22e-49ce-b73b-f46601188932" returned: 0 in 0.997s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6da8e536-ecad-4bb4-8395-c0fa109e7022 tempest-VolumesActionsTest-907624772 None] Lock "cinder-quobyte-82500d49-c22e-49ce-b73b-f46601188932" released by "delete_volume" :: held 2.256s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-09bdef99-9ac0-44d4-a2d3-767163e7df26 tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "cinder-quobyte-affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:40 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-09bdef99-9ac0-44d4-a2d3-767163e7df26 tempest-VolumesSnapshotListTestJSON-1562632331 None] Deleting offline snapshot affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c of volume 72b86a96-1457-47c7-a689-6726e595e789 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:06:40 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-09bdef99-9ac0-44d4-a2d3-767163e7df26 tempest-VolumesSnapshotListTestJSON-1562632331 None] snapshot_file for this snap is: volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:06:40 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef47a94d-7829-42c4-8028-81c735618246]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:06:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-09bdef99-9ac0-44d4-a2d3-767163e7df26 tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:40 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-6da8e536-ecad-4bb4-8395-c0fa109e7022 tempest-VolumesActionsTest-907624772 None] Created reservations ['6a0da12b-abd4-4aa6-a7f4-fe1be2d06b01', '19f84237-faef-475b-b2a3-6156d35f8ab7', 'bcfe9065-56dd-4a93-b8c7-aabc13360ca0', '2f0cabf9-a7f9-4cfd-a620-9ec62c2926f4'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:06:40 devstack sudo[94267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c
Jul 03 13:06:40 devstack sudo[94267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6da8e536-ecad-4bb4-8395-c0fa109e7022 tempest-VolumesActionsTest-907624772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:06:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6da8e536-ecad-4bb4-8395-c0fa109e7022 tempest-VolumesActionsTest-907624772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:06:40 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6da8e536-ecad-4bb4-8395-c0fa109e7022 tempest-VolumesActionsTest-907624772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:06:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6da8e536-ecad-4bb4-8395-c0fa109e7022 tempest-VolumesActionsTest-907624772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:06:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6da8e536-ecad-4bb4-8395-c0fa109e7022 tempest-VolumesActionsTest-907624772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6da8e536-ecad-4bb4-8395-c0fa109e7022 tempest-VolumesActionsTest-907624772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:41 devstack sudo[94269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:06:41 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:42 devstack sudo[94267]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-09bdef99-9ac0-44d4-a2d3-767163e7df26 tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c" returned: 0 in 1.536s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:42 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-09bdef99-9ac0-44d4-a2d3-767163e7df26 tempest-VolumesSnapshotListTestJSON-1562632331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b86a96-1457-47c7-a689-6726e595e789(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:06:42 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6da8e536-ecad-4bb4-8395-c0fa109e7022 tempest-VolumesActionsTest-907624772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.305s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:42 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-6da8e536-ecad-4bb4-8395-c0fa109e7022 tempest-VolumesActionsTest-907624772 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:06:42 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-6da8e536-ecad-4bb4-8395-c0fa109e7022 tempest-VolumesActionsTest-907624772 None] Deleted volume successfully.
Jul 03 13:06:42 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c371b8-c39d-44ee-9c1a-f4e5e352e961]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:06:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-09bdef99-9ac0-44d4-a2d3-767163e7df26 tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6da8e536-ecad-4bb4-8395-c0fa109e7022 tempest-VolumesActionsTest-907624772 None] Lock "cinder-82500d49-c22e-49ce-b73b-f46601188932-delete_volume" released by "delete_volume" :: held 4.146s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:42 devstack sudo[94303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789
Jul 03 13:06:42 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:43 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-09bdef99-9ac0-44d4-a2d3-767163e7df26 tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789" returned: 0 in 1.576s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-09bdef99-9ac0-44d4-a2d3-767163e7df26 tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:43 devstack sudo[94346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c
Jul 03 13:06:43 devstack sudo[94346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:45 devstack sudo[94346]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-09bdef99-9ac0-44d4-a2d3-767163e7df26 tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c" returned: 0 in 1.325s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-09bdef99-9ac0-44d4-a2d3-767163e7df26 tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:45 devstack sudo[94353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c
Jul 03 13:06:45 devstack sudo[94353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:46 devstack sudo[94353]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-09bdef99-9ac0-44d4-a2d3-767163e7df26 tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789.affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c" returned: 0 in 1.046s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:46 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:UPDATE=39,cinder:INSERT=13,cinder:SELECT=37,cinder:DELETE=5 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:06:46 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-09bdef99-9ac0-44d4-a2d3-767163e7df26 tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "cinder-quobyte-affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c" released by "_delete_snapshot" :: held 5.688s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:46 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-09bdef99-9ac0-44d4-a2d3-767163e7df26 tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "cinder-quobyte-72b86a96-1457-47c7-a689-6726e595e789" released by "delete_snapshot" :: held 5.762s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:46 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-09bdef99-9ac0-44d4-a2d3-767163e7df26 tempest-VolumesSnapshotListTestJSON-1562632331 None] Created reservations ['6860b480-59df-48d6-a9b4-4b2b7a7dc731', '78498be9-9feb-430d-aa42-df66f3a53285', '5120eb96-f3b7-47dc-a280-9a61adb9b784', 'ffb667b1-5dcb-4cf3-b71c-e6dfbd041236'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:06:46 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-09bdef99-9ac0-44d4-a2d3-767163e7df26 tempest-VolumesSnapshotListTestJSON-1562632331 None] Delete snapshot completed successfully.
Jul 03 13:06:46 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-09bdef99-9ac0-44d4-a2d3-767163e7df26 tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "cinder-affbb7f7-e5a7-4e75-ab7b-79c5b8e7e89c-delete_snapshot" released by "delete_snapshot" :: held 6.014s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-60138a88-b2a9-43df-be06-3530925adf51 tempest-VolumesSnapshotListTestJSON-1562632331 None] Acquiring lock "cinder-72b86a96-1457-47c7-a689-6726e595e789-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-60138a88-b2a9-43df-be06-3530925adf51 tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "cinder-72b86a96-1457-47c7-a689-6726e595e789-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-60138a88-b2a9-43df-be06-3530925adf51 tempest-VolumesSnapshotListTestJSON-1562632331 None] Acquiring lock "cinder-quobyte-72b86a96-1457-47c7-a689-6726e595e789" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-60138a88-b2a9-43df-be06-3530925adf51 tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "cinder-quobyte-72b86a96-1457-47c7-a689-6726e595e789" acquired by "delete_volume" :: waited 0.026s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:47 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b03524-91f0-4f90-880e-012d9ed7e1f9]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:06:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-60138a88-b2a9-43df-be06-3530925adf51 tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:47 devstack sudo[94360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789
Jul 03 13:06:47 devstack sudo[94360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:48 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=50,cinder:UPDATE=48,cinder:DELETE=2,cinder:INSERT=9 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:06:48 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:06:48 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Flow 'volume_create_manager' (d6bc5711-fed2-4280-89dc-87ba3a68fb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:06:48 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (111d6050-d321-49b7-81f6-99922b4d5061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:48 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (111d6050-d321-49b7-81f6-99922b4d5061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-531774682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8d30da4-a307-4b70-9854-900a0bc02467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee5780dc844b4377a0a1f08930dfe923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:48Z,use_quota=True,user_id='33f844438e40491ca2eaeeb9d6b78052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:48 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ab26ff-26c0-4ab9-9405-41da8b2c0f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:48 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ab26ff-26c0-4ab9-9405-41da8b2c0f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:48 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb13173-b19c-4b66-8c16-1c6c45cce118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:48 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb13173-b19c-4b66-8c16-1c6c45cce118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8d30da4-a307-4b70-9854-900a0bc02467', 'volume_name': 'volume-a8d30da4-a307-4b70-9854-900a0bc02467', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:48 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9081abac-6dde-4a73-9a68-f493c5cc8569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:48 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9081abac-6dde-4a73-9a68-f493c5cc8569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:48 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (658aba05-219c-4e5a-9589-0f77c0165972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:48 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Volume a8d30da4-a307-4b70-9854-900a0bc02467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8d30da4-a307-4b70-9854-900a0bc02467', 'volume_size': 1}
Jul 03 13:06:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:06:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:06:48 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-531774682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8d30da4-a307-4b70-9854-900a0bc02467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee5780dc844b4377a0a1f08930dfe923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:48Z,use_quota=True,user_id='33f844438e40491ca2eaeeb9d6b78052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:06:48 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Creating volume a8d30da4-a307-4b70-9854-900a0bc02467 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:06:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:06:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:06:48 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:06:48 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:06:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:48 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:06:48 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:06:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a8d30da4-a307-4b70-9854-900a0bc02467 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:48 devstack sudo[94362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a8d30da4-a307-4b70-9854-900a0bc02467 1073741824
Jul 03 13:06:48 devstack sudo[94362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:48 devstack sudo[94360]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-60138a88-b2a9-43df-be06-3530925adf51 tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789" returned: 0 in 1.425s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-60138a88-b2a9-43df-be06-3530925adf51 tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:48 devstack sudo[94367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789
Jul 03 13:06:48 devstack sudo[94367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:49 devstack sudo[94362]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a8d30da4-a307-4b70-9854-900a0bc02467 1073741824" returned: 0 in 1.499s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a8d30da4-a307-4b70-9854-900a0bc02467 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:49 devstack sudo[94373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a8d30da4-a307-4b70-9854-900a0bc02467
Jul 03 13:06:49 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:50 devstack sudo[94367]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-60138a88-b2a9-43df-be06-3530925adf51 tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-72b86a96-1457-47c7-a689-6726e595e789" returned: 0 in 1.060s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-60138a88-b2a9-43df-be06-3530925adf51 tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "cinder-quobyte-72b86a96-1457-47c7-a689-6726e595e789" released by "delete_volume" :: held 2.628s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:50 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-60138a88-b2a9-43df-be06-3530925adf51 tempest-VolumesSnapshotListTestJSON-1562632331 None] Created reservations ['40d56f9a-b1fb-4951-8d4e-f328f8c9106d', 'f9113c85-4911-4463-bacc-0044a887965e', '994628cd-e9c6-4100-af03-e5ab9b8ad3ce', '70c1d042-ba9a-4140-824f-a3cbe975ec9d'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:06:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-60138a88-b2a9-43df-be06-3530925adf51 tempest-VolumesSnapshotListTestJSON-1562632331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:06:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-60138a88-b2a9-43df-be06-3530925adf51 tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:06:50 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-60138a88-b2a9-43df-be06-3530925adf51 tempest-VolumesSnapshotListTestJSON-1562632331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:06:50 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-60138a88-b2a9-43df-be06-3530925adf51 tempest-VolumesSnapshotListTestJSON-1562632331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:06:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-60138a88-b2a9-43df-be06-3530925adf51 tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-60138a88-b2a9-43df-be06-3530925adf51 tempest-VolumesSnapshotListTestJSON-1562632331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:50 devstack sudo[94376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:06:50 devstack sudo[94376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:50 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a8d30da4-a307-4b70-9854-900a0bc02467" returned: 0 in 0.846s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:50 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] <== create_volume: return (2404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:06:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.412s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:50 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (658aba05-219c-4e5a-9589-0f77c0165972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8d30da4-a307-4b70-9854-900a0bc02467', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:50 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dda5221-1256-49b1-a43a-a18ae7e56e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:50 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Volume volume-a8d30da4-a307-4b70-9854-900a0bc02467 (a8d30da4-a307-4b70-9854-900a0bc02467): created successfully
Jul 03 13:06:50 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dda5221-1256-49b1-a43a-a18ae7e56e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:50 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Flow 'volume_create_manager' (d6bc5711-fed2-4280-89dc-87ba3a68fb5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:06:50 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-ef72761a-eb20-4e00-b300-c361b24b326b tempest-AttachVolumeNegativeTest-2100265475 None] Created volume successfully.
Jul 03 13:06:51 devstack sudo[94376]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-60138a88-b2a9-43df-be06-3530925adf51 tempest-VolumesSnapshotListTestJSON-1562632331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.190s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:51 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-60138a88-b2a9-43df-be06-3530925adf51 tempest-VolumesSnapshotListTestJSON-1562632331 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:06:51 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-60138a88-b2a9-43df-be06-3530925adf51 tempest-VolumesSnapshotListTestJSON-1562632331 None] Deleted volume successfully.
Jul 03 13:06:51 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-60138a88-b2a9-43df-be06-3530925adf51 tempest-VolumesSnapshotListTestJSON-1562632331 None] Lock "cinder-72b86a96-1457-47c7-a689-6726e595e789-delete_volume" released by "delete_volume" :: held 4.179s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:51 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:06:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Flow 'volume_create_manager' (f8cf28c2-661c-400f-bd18-5d22674f41d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:06:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01e296aa-fbcd-4e5a-be6a-aafc0797ba4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01e296aa-fbcd-4e5a-be6a-aafc0797ba4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1661227840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640e73f7-8d07-4f80-ac25-32fb75c7c5c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eecb317dca44a9a84c1fa43171306c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:52Z,use_quota=True,user_id='9e6e3c1ebb654d97bfc019c6ec7a4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ed966e-7b87-489a-87b7-026a4a63a7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ed966e-7b87-489a-87b7-026a4a63a7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef17baff-5bb5-44ad-a1e2-f3d276de3a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef17baff-5bb5-44ad-a1e2-f3d276de3a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '640e73f7-8d07-4f80-ac25-32fb75c7c5c5', 'volume_name': 'volume-640e73f7-8d07-4f80-ac25-32fb75c7c5c5', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b2cb042-051a-41cc-b95b-e8623ff58ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b2cb042-051a-41cc-b95b-e8623ff58ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce446a34-d337-4882-b4e9-c8f4ada4c444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:51 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Volume 640e73f7-8d07-4f80-ac25-32fb75c7c5c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-640e73f7-8d07-4f80-ac25-32fb75c7c5c5', 'volume_size': 1}
Jul 03 13:06:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:06:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:06:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1661227840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640e73f7-8d07-4f80-ac25-32fb75c7c5c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eecb317dca44a9a84c1fa43171306c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:52Z,use_quota=True,user_id='9e6e3c1ebb654d97bfc019c6ec7a4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:06:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Creating volume 640e73f7-8d07-4f80-ac25-32fb75c7c5c5 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:06:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:06:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:06:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:06:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:06:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:06:51 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:06:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-640e73f7-8d07-4f80-ac25-32fb75c7c5c5 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:52 devstack sudo[94393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-640e73f7-8d07-4f80-ac25-32fb75c7c5c5 1073741824
Jul 03 13:06:52 devstack sudo[94393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-640e73f7-8d07-4f80-ac25-32fb75c7c5c5 1073741824" returned: 0 in 1.296s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:53 devstack sudo[94393]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-640e73f7-8d07-4f80-ac25-32fb75c7c5c5 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:53 devstack sudo[94400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-640e73f7-8d07-4f80-ac25-32fb75c7c5c5
Jul 03 13:06:53 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:54 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-640e73f7-8d07-4f80-ac25-32fb75c7c5c5" returned: 0 in 0.928s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:54 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] <== create_volume: return (2342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:06:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.346s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce446a34-d337-4882-b4e9-c8f4ada4c444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-640e73f7-8d07-4f80-ac25-32fb75c7c5c5', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22e6fe17-15e2-42ee-a6b9-3da80fd481f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:54 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Volume volume-640e73f7-8d07-4f80-ac25-32fb75c7c5c5 (640e73f7-8d07-4f80-ac25-32fb75c7c5c5): created successfully
Jul 03 13:06:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22e6fe17-15e2-42ee-a6b9-3da80fd481f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Flow 'volume_create_manager' (f8cf28c2-661c-400f-bd18-5d22674f41d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:06:54 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-0daac8fb-b4c5-4732-b59b-9ab88909b56c tempest-VolumesActionsTest-907624772 None] Created volume successfully.
Jul 03 13:06:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b8af01c6-5a30-4339-bd65-9a2961df4b1c tempest-VolumesActionsTest-559339855 None] Acquiring lock "cinder-640e73f7-8d07-4f80-ac25-32fb75c7c5c5-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b8af01c6-5a30-4339-bd65-9a2961df4b1c tempest-VolumesActionsTest-559339855 None] Lock "cinder-640e73f7-8d07-4f80-ac25-32fb75c7c5c5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b8af01c6-5a30-4339-bd65-9a2961df4b1c tempest-VolumesActionsTest-559339855 None] Acquiring lock "cinder-quobyte-640e73f7-8d07-4f80-ac25-32fb75c7c5c5" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:06:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b8af01c6-5a30-4339-bd65-9a2961df4b1c tempest-VolumesActionsTest-559339855 None] Lock "cinder-quobyte-640e73f7-8d07-4f80-ac25-32fb75c7c5c5" acquired by "delete_volume" :: waited 0.024s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:06:55 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[330512b2-7c32-44f0-b54e-6c83c41e9ba9]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:06:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b8af01c6-5a30-4339-bd65-9a2961df4b1c tempest-VolumesActionsTest-559339855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-640e73f7-8d07-4f80-ac25-32fb75c7c5c5 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:55 devstack sudo[94406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-640e73f7-8d07-4f80-ac25-32fb75c7c5c5
Jul 03 13:06:55 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-ad38b03b-50ff-43ab-8d3d-e440bc59a33e req-bb06639e-1bf1-4ba9-bc92-984d1ff78e40 tempest-AttachVolumeNegativeTest-2100265475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:06:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-ad38b03b-50ff-43ab-8d3d-e440bc59a33e req-bb06639e-1bf1-4ba9-bc92-984d1ff78e40 tempest-AttachVolumeNegativeTest-2100265475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:06:55 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ec954a-228a-4133-8e36-f956153e0bd6]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:06:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-ad38b03b-50ff-43ab-8d3d-e440bc59a33e req-bb06639e-1bf1-4ba9-bc92-984d1ff78e40 tempest-AttachVolumeNegativeTest-2100265475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a8d30da4-a307-4b70-9854-900a0bc02467 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:55 devstack sudo[94414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a8d30da4-a307-4b70-9854-900a0bc02467
Jul 03 13:06:55 devstack sudo[94414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:56 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:06:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Flow 'volume_create_manager' (0ff74a10-92bc-4896-b496-e90957d48066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:06:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff88f1e-3013-4279-8fb6-aa6e1e07dc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff88f1e-3013-4279-8fb6-aa6e1e07dc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-469209956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c28d9a03-8125-49d5-8038-a115418bdf4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9908ccb593b043a29c6e824049f78f2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:56Z,use_quota=True,user_id='6e690991d4da4d3da0f5ca1f25e4471e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d16a14d2-e856-4e4c-ac47-2841583a2795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d16a14d2-e856-4e4c-ac47-2841583a2795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba1c9d5b-b7f9-4369-99f3-1906db20732d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba1c9d5b-b7f9-4369-99f3-1906db20732d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c28d9a03-8125-49d5-8038-a115418bdf4c', 'volume_name': 'volume-c28d9a03-8125-49d5-8038-a115418bdf4c', 'volume_size': 2}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0885d07f-d87b-4b3f-9d2b-2de9b0b009d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0885d07f-d87b-4b3f-9d2b-2de9b0b009d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63514e2-a9d7-4ebb-9b05-04bf8b189b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:56 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Volume c28d9a03-8125-49d5-8038-a115418bdf4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c28d9a03-8125-49d5-8038-a115418bdf4c', 'volume_size': 2}
Jul 03 13:06:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:06:56 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b8af01c6-5a30-4339-bd65-9a2961df4b1c tempest-VolumesActionsTest-559339855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-640e73f7-8d07-4f80-ac25-32fb75c7c5c5" returned: 0 in 1.346s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b8af01c6-5a30-4339-bd65-9a2961df4b1c tempest-VolumesActionsTest-559339855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-640e73f7-8d07-4f80-ac25-32fb75c7c5c5 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:56 devstack sudo[94419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-640e73f7-8d07-4f80-ac25-32fb75c7c5c5
Jul 03 13:06:56 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:56 devstack sudo[94414]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-ad38b03b-50ff-43ab-8d3d-e440bc59a33e req-bb06639e-1bf1-4ba9-bc92-984d1ff78e40 tempest-AttachVolumeNegativeTest-2100265475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a8d30da4-a307-4b70-9854-900a0bc02467" returned: 0 in 1.311s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-ad38b03b-50ff-43ab-8d3d-e440bc59a33e req-bb06639e-1bf1-4ba9-bc92-984d1ff78e40 tempest-AttachVolumeNegativeTest-2100265475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.344s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.469s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:06:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-469209956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c28d9a03-8125-49d5-8038-a115418bdf4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9908ccb593b043a29c6e824049f78f2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:56Z,use_quota=True,user_id='6e690991d4da4d3da0f5ca1f25e4471e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:06:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Creating volume c28d9a03-8125-49d5-8038-a115418bdf4c {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:06:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:06:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:06:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:06:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:06:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:06:56 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:06:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c 2147483648 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:56 devstack sudo[94424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c 2147483648
Jul 03 13:06:56 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-ad38b03b-50ff-43ab-8d3d-e440bc59a33e req-bb06639e-1bf1-4ba9-bc92-984d1ff78e40 tempest-AttachVolumeNegativeTest-2100265475 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db', 'name': 'volume-a8d30da4-a307-4b70-9854-900a0bc02467', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fdf2e2f2-f769-49d2-a3ea-52bf8cd26194', 'enforce_multipath': True} {{(pid=86837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 13:06:56 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-ad38b03b-50ff-43ab-8d3d-e440bc59a33e req-bb06639e-1bf1-4ba9-bc92-984d1ff78e40 tempest-AttachVolumeNegativeTest-2100265475 None] attachment_update completed successfully.
Jul 03 13:06:57 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b8af01c6-5a30-4339-bd65-9a2961df4b1c tempest-VolumesActionsTest-559339855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-640e73f7-8d07-4f80-ac25-32fb75c7c5c5" returned: 0 in 0.858s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b8af01c6-5a30-4339-bd65-9a2961df4b1c tempest-VolumesActionsTest-559339855 None] Lock "cinder-quobyte-640e73f7-8d07-4f80-ac25-32fb75c7c5c5" released by "delete_volume" :: held 2.255s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:57 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-b8af01c6-5a30-4339-bd65-9a2961df4b1c tempest-VolumesActionsTest-559339855 None] Created reservations ['24737054-a5c2-4521-b760-9996e184f098', 'bc5a24f6-680e-4e24-9a2d-91369cdd7aac', 'de06b502-f07d-4cdb-9c5d-c2ebc0b58646', '13c69198-985b-4f4f-b453-eb577181873f'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:06:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b8af01c6-5a30-4339-bd65-9a2961df4b1c tempest-VolumesActionsTest-559339855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:06:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b8af01c6-5a30-4339-bd65-9a2961df4b1c tempest-VolumesActionsTest-559339855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:06:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b8af01c6-5a30-4339-bd65-9a2961df4b1c tempest-VolumesActionsTest-559339855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:06:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b8af01c6-5a30-4339-bd65-9a2961df4b1c tempest-VolumesActionsTest-559339855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:06:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b8af01c6-5a30-4339-bd65-9a2961df4b1c tempest-VolumesActionsTest-559339855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b8af01c6-5a30-4339-bd65-9a2961df4b1c tempest-VolumesActionsTest-559339855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:57 devstack sudo[94428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:06:57 devstack sudo[94428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:58 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c 2147483648" returned: 0 in 1.176s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:58 devstack sudo[94501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c
Jul 03 13:06:58 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:58 devstack sudo[94428]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b8af01c6-5a30-4339-bd65-9a2961df4b1c tempest-VolumesActionsTest-559339855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.853s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:58 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-b8af01c6-5a30-4339-bd65-9a2961df4b1c tempest-VolumesActionsTest-559339855 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:06:58 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-b8af01c6-5a30-4339-bd65-9a2961df4b1c tempest-VolumesActionsTest-559339855 None] Deleted volume successfully.
Jul 03 13:06:58 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b8af01c6-5a30-4339-bd65-9a2961df4b1c tempest-VolumesActionsTest-559339855 None] Lock "cinder-640e73f7-8d07-4f80-ac25-32fb75c7c5c5-delete_volume" released by "delete_volume" :: held 3.437s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:06:59 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c" returned: 0 in 0.970s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] <== create_volume: return (2203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.209s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63514e2-a9d7-4ebb-9b05-04bf8b189b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c28d9a03-8125-49d5-8038-a115418bdf4c', 'volume_size': 2}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109369d3-5a0f-4676-ba0f-3b9572a5d440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:59 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Volume volume-c28d9a03-8125-49d5-8038-a115418bdf4c (c28d9a03-8125-49d5-8038-a115418bdf4c): created successfully
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109369d3-5a0f-4676-ba0f-3b9572a5d440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Flow 'volume_create_manager' (0ff74a10-92bc-4896-b496-e90957d48066) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:06:59 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-3b0cabe9-90bc-4431-91b5-30ddda6e48aa tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Created volume successfully.
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Flow 'volume_create_manager' (14da9650-6e0d-4b68-bf3c-b9e4fdc14446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (522cddf3-950e-4223-b14e-6188b1cb5e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (522cddf3-950e-4223-b14e-6188b1cb5e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2075179229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dbd3c1f-d50d-4267-b0d0-bdf2adadd2c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eecb317dca44a9a84c1fa43171306c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:59Z,use_quota=True,user_id='9e6e3c1ebb654d97bfc019c6ec7a4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (723c225c-252d-4b75-86fb-b54eb54daf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (723c225c-252d-4b75-86fb-b54eb54daf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4fbc510-1f0c-47f6-9f49-bb6d0f335e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4fbc510-1f0c-47f6-9f49-bb6d0f335e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dbd3c1f-d50d-4267-b0d0-bdf2adadd2c7', 'volume_name': 'volume-9dbd3c1f-d50d-4267-b0d0-bdf2adadd2c7', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af11f2e5-e263-498f-a989-8692b9cff0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af11f2e5-e263-498f-a989-8692b9cff0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f006b47-fe4a-4480-8c3f-ccd54399fc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:06:59 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Volume 9dbd3c1f-d50d-4267-b0d0-bdf2adadd2c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dbd3c1f-d50d-4267-b0d0-bdf2adadd2c7', 'volume_size': 1}
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2075179229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dbd3c1f-d50d-4267-b0d0-bdf2adadd2c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eecb317dca44a9a84c1fa43171306c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:06:59Z,use_quota=True,user_id='9e6e3c1ebb654d97bfc019c6ec7a4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Creating volume 9dbd3c1f-d50d-4267-b0d0-bdf2adadd2c7 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:06:59 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9dbd3c1f-d50d-4267-b0d0-bdf2adadd2c7 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:06:59 devstack sudo[94825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9dbd3c1f-d50d-4267-b0d0-bdf2adadd2c7 1073741824
Jul 03 13:06:59 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:06:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4afc3bb4-7ef7-420e-8cac-926080d979ef tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:00 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9dbd3c1f-d50d-4267-b0d0-bdf2adadd2c7 1073741824" returned: 0 in 1.228s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9dbd3c1f-d50d-4267-b0d0-bdf2adadd2c7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:00 devstack sudo[94834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9dbd3c1f-d50d-4267-b0d0-bdf2adadd2c7
Jul 03 13:07:00 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:01 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9dbd3c1f-d50d-4267-b0d0-bdf2adadd2c7" returned: 0 in 0.689s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:01 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] <== create_volume: return (1975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:07:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.978s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4afc3bb4-7ef7-420e-8cac-926080d979ef tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.328s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:01 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f006b47-fe4a-4480-8c3f-ccd54399fc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dbd3c1f-d50d-4267-b0d0-bdf2adadd2c7', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:01 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c22276-1024-4c1a-b9d4-e28940b60a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:01 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-4afc3bb4-7ef7-420e-8cac-926080d979ef tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Creating offline snapshot a1ae8891-4508-4080-9676-081c1134c101 of volume c28d9a03-8125-49d5-8038-a115418bdf4c {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:07:01 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Volume volume-9dbd3c1f-d50d-4267-b0d0-bdf2adadd2c7 (9dbd3c1f-d50d-4267-b0d0-bdf2adadd2c7): created successfully
Jul 03 13:07:01 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c22276-1024-4c1a-b9d4-e28940b60a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:01 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Flow 'volume_create_manager' (14da9650-6e0d-4b68-bf3c-b9e4fdc14446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:07:01 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9b169a-7c87-4d4a-aaf0-5a201c0e9cd8]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4afc3bb4-7ef7-420e-8cac-926080d979ef tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:01 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-67b48325-c9c4-4027-87b9-aeb1962e80e7 tempest-VolumesActionsTest-907624772 None] Created volume successfully.
Jul 03 13:07:01 devstack sudo[94837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c
Jul 03 13:07:01 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:02 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4afc3bb4-7ef7-420e-8cac-926080d979ef tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c" returned: 0 in 0.914s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4afc3bb4-7ef7-420e-8cac-926080d979ef tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c.a1ae8891-4508-4080-9676-081c1134c101 2G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:02 devstack sudo[94843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c.a1ae8891-4508-4080-9676-081c1134c101 2G
Jul 03 13:07:02 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:02 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d63eb5a4-4d62-487e-baa4-050c6992a469 tempest-VolumesActionsTest-559339855 None] Acquiring lock "cinder-9dbd3c1f-d50d-4267-b0d0-bdf2adadd2c7-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:07:02 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d63eb5a4-4d62-487e-baa4-050c6992a469 tempest-VolumesActionsTest-559339855 None] Lock "cinder-9dbd3c1f-d50d-4267-b0d0-bdf2adadd2c7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:07:02 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d63eb5a4-4d62-487e-baa4-050c6992a469 tempest-VolumesActionsTest-559339855 None] Acquiring lock "cinder-quobyte-9dbd3c1f-d50d-4267-b0d0-bdf2adadd2c7" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:07:02 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d63eb5a4-4d62-487e-baa4-050c6992a469 tempest-VolumesActionsTest-559339855 None] Lock "cinder-quobyte-9dbd3c1f-d50d-4267-b0d0-bdf2adadd2c7" acquired by "delete_volume" :: waited 0.016s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:07:02 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[837add18-b3f0-4b1a-8e8f-0e8ac13c7c23]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d63eb5a4-4d62-487e-baa4-050c6992a469 tempest-VolumesActionsTest-559339855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9dbd3c1f-d50d-4267-b0d0-bdf2adadd2c7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:02 devstack sudo[94846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9dbd3c1f-d50d-4267-b0d0-bdf2adadd2c7
Jul 03 13:07:02 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:03 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-b22e3bac-c39a-4448-8c38-4c66c6310a32 req-00fe746d-7c40-4563-9e99-16149ee2f9f7 tempest-AttachVolumeNegativeTest-2100265475 None] Terminate volume connection completed successfully.
Jul 03 13:07:03 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-b22e3bac-c39a-4448-8c38-4c66c6310a32 req-00fe746d-7c40-4563-9e99-16149ee2f9f7 tempest-AttachVolumeNegativeTest-2100265475 None] Deleting attachment fdf2e2f2-f769-49d2-a3ea-52bf8cd26194. {{(pid=86837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:07:03 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4afc3bb4-7ef7-420e-8cac-926080d979ef tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c.a1ae8891-4508-4080-9676-081c1134c101 2G" returned: 0 in 1.186s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4afc3bb4-7ef7-420e-8cac-926080d979ef tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c28d9a03-8125-49d5-8038-a115418bdf4c -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c.a1ae8891-4508-4080-9676-081c1134c101 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:03 devstack sudo[94882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c28d9a03-8125-49d5-8038-a115418bdf4c -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c.a1ae8891-4508-4080-9676-081c1134c101
Jul 03 13:07:03 devstack sudo[94882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:03 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d63eb5a4-4d62-487e-baa4-050c6992a469 tempest-VolumesActionsTest-559339855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9dbd3c1f-d50d-4267-b0d0-bdf2adadd2c7" returned: 0 in 0.995s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d63eb5a4-4d62-487e-baa4-050c6992a469 tempest-VolumesActionsTest-559339855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9dbd3c1f-d50d-4267-b0d0-bdf2adadd2c7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:03 devstack sudo[94884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9dbd3c1f-d50d-4267-b0d0-bdf2adadd2c7
Jul 03 13:07:03 devstack sudo[94884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:04 devstack sudo[94884]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d63eb5a4-4d62-487e-baa4-050c6992a469 tempest-VolumesActionsTest-559339855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9dbd3c1f-d50d-4267-b0d0-bdf2adadd2c7" returned: 0 in 0.757s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d63eb5a4-4d62-487e-baa4-050c6992a469 tempest-VolumesActionsTest-559339855 None] Lock "cinder-quobyte-9dbd3c1f-d50d-4267-b0d0-bdf2adadd2c7" released by "delete_volume" :: held 1.802s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:07:04 devstack sudo[94882]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4afc3bb4-7ef7-420e-8cac-926080d979ef tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c28d9a03-8125-49d5-8038-a115418bdf4c -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c.a1ae8891-4508-4080-9676-081c1134c101" returned: 0 in 0.992s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:04 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-4afc3bb4-7ef7-420e-8cac-926080d979ef tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c.a1ae8891-4508-4080-9676-081c1134c101 is being set with open permissions: ugo+rw
Jul 03 13:07:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4afc3bb4-7ef7-420e-8cac-926080d979ef tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c.a1ae8891-4508-4080-9676-081c1134c101 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:04 devstack sudo[94890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c.a1ae8891-4508-4080-9676-081c1134c101
Jul 03 13:07:04 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:04 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-d63eb5a4-4d62-487e-baa4-050c6992a469 tempest-VolumesActionsTest-559339855 None] Created reservations ['7efa5c61-b20b-44ce-b7ef-f6bff84ce655', '14204fd0-ed4a-4213-9f82-080303852497', 'b3f05204-0463-4592-a369-c3df4cf2458e', 'f3724f88-fee5-4c52-b548-b39e799c9d98'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:07:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d63eb5a4-4d62-487e-baa4-050c6992a469 tempest-VolumesActionsTest-559339855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d63eb5a4-4d62-487e-baa4-050c6992a469 tempest-VolumesActionsTest-559339855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d63eb5a4-4d62-487e-baa4-050c6992a469 tempest-VolumesActionsTest-559339855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:07:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d63eb5a4-4d62-487e-baa4-050c6992a469 tempest-VolumesActionsTest-559339855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:07:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d63eb5a4-4d62-487e-baa4-050c6992a469 tempest-VolumesActionsTest-559339855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d63eb5a4-4d62-487e-baa4-050c6992a469 tempest-VolumesActionsTest-559339855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:04 devstack sudo[94892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:07:04 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4afc3bb4-7ef7-420e-8cac-926080d979ef tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c.a1ae8891-4508-4080-9676-081c1134c101" returned: 0 in 1.124s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:05 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4afc3bb4-7ef7-420e-8cac-926080d979ef tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:05 devstack sudo[94895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c.info
Jul 03 13:07:05 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:05 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:07:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Flow 'volume_create_manager' (3bb3f878-5f05-4863-8197-ab502cd27413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:07:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e4eb20-63d1-40cf-8190-1a18de3a2495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e4eb20-63d1-40cf-8190-1a18de3a2495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-707268008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb55c638-8ff4-4dcd-a507-6c57aa7833de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eecb317dca44a9a84c1fa43171306c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:06Z,use_quota=True,user_id='9e6e3c1ebb654d97bfc019c6ec7a4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e838c10e-d603-4784-b170-2376af132e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e838c10e-d603-4784-b170-2376af132e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:05 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9be673-765f-45c9-b4cd-0dd6fa0b657d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9be673-765f-45c9-b4cd-0dd6fa0b657d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb55c638-8ff4-4dcd-a507-6c57aa7833de', 'volume_name': 'volume-fb55c638-8ff4-4dcd-a507-6c57aa7833de', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f67b22-3fd3-44f5-a699-ea7b66ae2e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f67b22-3fd3-44f5-a699-ea7b66ae2e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c65e05a-6df6-4560-82eb-0209cb10afab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:06 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Volume fb55c638-8ff4-4dcd-a507-6c57aa7833de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb55c638-8ff4-4dcd-a507-6c57aa7833de', 'volume_size': 1}
Jul 03 13:07:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d63eb5a4-4d62-487e-baa4-050c6992a469 tempest-VolumesActionsTest-559339855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.375s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:06 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-d63eb5a4-4d62-487e-baa4-050c6992a469 tempest-VolumesActionsTest-559339855 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:07:06 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-d63eb5a4-4d62-487e-baa4-050c6992a469 tempest-VolumesActionsTest-559339855 None] Deleted volume successfully.
Jul 03 13:07:06 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d63eb5a4-4d62-487e-baa4-050c6992a469 tempest-VolumesActionsTest-559339855 None] Lock "cinder-9dbd3c1f-d50d-4267-b0d0-bdf2adadd2c7-delete_volume" released by "delete_volume" :: held 3.518s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:07:06 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4afc3bb4-7ef7-420e-8cac-926080d979ef tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c.info" returned: 0 in 1.105s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:06 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-4afc3bb4-7ef7-420e-8cac-926080d979ef tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c.info is being set with open permissions: ugo+rw
Jul 03 13:07:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4afc3bb4-7ef7-420e-8cac-926080d979ef tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:06 devstack sudo[94910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c.info
Jul 03 13:07:06 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:07 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4afc3bb4-7ef7-420e-8cac-926080d979ef tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c.info" returned: 0 in 1.083s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4afc3bb4-7ef7-420e-8cac-926080d979ef tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.609s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.909s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:07 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-707268008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb55c638-8ff4-4dcd-a507-6c57aa7833de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eecb317dca44a9a84c1fa43171306c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:06Z,use_quota=True,user_id='9e6e3c1ebb654d97bfc019c6ec7a4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:07:07 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Creating volume fb55c638-8ff4-4dcd-a507-6c57aa7833de {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:07:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:07 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:07:07 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:07:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:07 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:07:07 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:07:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fb55c638-8ff4-4dcd-a507-6c57aa7833de 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:08 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-4afc3bb4-7ef7-420e-8cac-926080d979ef tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Create snapshot completed successfully
Jul 03 13:07:08 devstack sudo[94954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fb55c638-8ff4-4dcd-a507-6c57aa7833de 1073741824
Jul 03 13:07:08 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e05bba3c-eebd-4ec3-9386-364d686a8615 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Acquiring lock "cinder-a1ae8891-4508-4080-9676-081c1134c101-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:07:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e05bba3c-eebd-4ec3-9386-364d686a8615 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Lock "cinder-a1ae8891-4508-4080-9676-081c1134c101-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:07:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e05bba3c-eebd-4ec3-9386-364d686a8615 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Acquiring lock "cinder-quobyte-c28d9a03-8125-49d5-8038-a115418bdf4c" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:07:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e05bba3c-eebd-4ec3-9386-364d686a8615 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Lock "cinder-quobyte-c28d9a03-8125-49d5-8038-a115418bdf4c" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:07:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e05bba3c-eebd-4ec3-9386-364d686a8615 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Acquiring lock "cinder-quobyte-a1ae8891-4508-4080-9676-081c1134c101" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:07:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e05bba3c-eebd-4ec3-9386-364d686a8615 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Lock "cinder-quobyte-a1ae8891-4508-4080-9676-081c1134c101" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:07:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-e05bba3c-eebd-4ec3-9386-364d686a8615 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Deleting offline snapshot a1ae8891-4508-4080-9676-081c1134c101 of volume c28d9a03-8125-49d5-8038-a115418bdf4c {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:07:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-e05bba3c-eebd-4ec3-9386-364d686a8615 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] snapshot_file for this snap is: volume-c28d9a03-8125-49d5-8038-a115418bdf4c.a1ae8891-4508-4080-9676-081c1134c101 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:07:08 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e07568-318e-422b-8240-dd0e21c90ce6]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e05bba3c-eebd-4ec3-9386-364d686a8615 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c.a1ae8891-4508-4080-9676-081c1134c101 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:09 devstack sudo[94961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c.a1ae8891-4508-4080-9676-081c1134c101
Jul 03 13:07:09 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:09 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fb55c638-8ff4-4dcd-a507-6c57aa7833de 1073741824" returned: 0 in 1.308s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fb55c638-8ff4-4dcd-a507-6c57aa7833de {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:09 devstack sudo[94964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fb55c638-8ff4-4dcd-a507-6c57aa7833de
Jul 03 13:07:09 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:10 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e05bba3c-eebd-4ec3-9386-364d686a8615 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c.a1ae8891-4508-4080-9676-081c1134c101" returned: 0 in 1.256s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:10 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-e05bba3c-eebd-4ec3-9386-364d686a8615 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c28d9a03-8125-49d5-8038-a115418bdf4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:07:10 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d153dd22-653c-456f-b877-c756d4fac45a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e05bba3c-eebd-4ec3-9386-364d686a8615 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:10 devstack sudo[94971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c
Jul 03 13:07:10 devstack sudo[94971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:10 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fb55c638-8ff4-4dcd-a507-6c57aa7833de" returned: 0 in 1.153s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:10 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] <== create_volume: return (2569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:07:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.579s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:10 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c65e05a-6df6-4560-82eb-0209cb10afab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb55c638-8ff4-4dcd-a507-6c57aa7833de', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:10 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc813753-cdf2-47cb-98c9-df590e592d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:10 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Volume volume-fb55c638-8ff4-4dcd-a507-6c57aa7833de (fb55c638-8ff4-4dcd-a507-6c57aa7833de): created successfully
Jul 03 13:07:10 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc813753-cdf2-47cb-98c9-df590e592d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:10 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Flow 'volume_create_manager' (3bb3f878-5f05-4863-8197-ab502cd27413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:07:10 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-e55a77c3-e940-40de-8810-a1922c0b9afc tempest-VolumesActionsTest-907624772 None] Created volume successfully.
Jul 03 13:07:11 devstack sudo[94971]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e05bba3c-eebd-4ec3-9386-364d686a8615 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c" returned: 0 in 0.991s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e05bba3c-eebd-4ec3-9386-364d686a8615 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c.a1ae8891-4508-4080-9676-081c1134c101 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:11 devstack sudo[94977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c.a1ae8891-4508-4080-9676-081c1134c101
Jul 03 13:07:11 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:11 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-29b53c2b-3fc4-4e12-9fe9-1546b8b3c393 tempest-VolumesActionsTest-559339855 None] Acquiring lock "cinder-fb55c638-8ff4-4dcd-a507-6c57aa7833de-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:07:11 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-29b53c2b-3fc4-4e12-9fe9-1546b8b3c393 tempest-VolumesActionsTest-559339855 None] Lock "cinder-fb55c638-8ff4-4dcd-a507-6c57aa7833de-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:07:11 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-29b53c2b-3fc4-4e12-9fe9-1546b8b3c393 tempest-VolumesActionsTest-559339855 None] Acquiring lock "cinder-quobyte-fb55c638-8ff4-4dcd-a507-6c57aa7833de" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:07:11 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-29b53c2b-3fc4-4e12-9fe9-1546b8b3c393 tempest-VolumesActionsTest-559339855 None] Lock "cinder-quobyte-fb55c638-8ff4-4dcd-a507-6c57aa7833de" acquired by "delete_volume" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:07:11 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd3b6e2-88a8-4acc-9a99-5edf557d4b41]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-29b53c2b-3fc4-4e12-9fe9-1546b8b3c393 tempest-VolumesActionsTest-559339855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fb55c638-8ff4-4dcd-a507-6c57aa7833de {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:11 devstack sudo[94979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fb55c638-8ff4-4dcd-a507-6c57aa7833de
Jul 03 13:07:11 devstack sudo[94979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:12 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e05bba3c-eebd-4ec3-9386-364d686a8615 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c.a1ae8891-4508-4080-9676-081c1134c101" returned: 0 in 0.944s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e05bba3c-eebd-4ec3-9386-364d686a8615 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c.a1ae8891-4508-4080-9676-081c1134c101 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:12 devstack sudo[94988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c.a1ae8891-4508-4080-9676-081c1134c101
Jul 03 13:07:12 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:12 devstack sudo[94979]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-29b53c2b-3fc4-4e12-9fe9-1546b8b3c393 tempest-VolumesActionsTest-559339855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fb55c638-8ff4-4dcd-a507-6c57aa7833de" returned: 0 in 0.906s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-29b53c2b-3fc4-4e12-9fe9-1546b8b3c393 tempest-VolumesActionsTest-559339855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fb55c638-8ff4-4dcd-a507-6c57aa7833de {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:12 devstack sudo[94994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fb55c638-8ff4-4dcd-a507-6c57aa7833de
Jul 03 13:07:12 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:13 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e05bba3c-eebd-4ec3-9386-364d686a8615 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c.a1ae8891-4508-4080-9676-081c1134c101" returned: 0 in 0.831s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e05bba3c-eebd-4ec3-9386-364d686a8615 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Lock "cinder-quobyte-a1ae8891-4508-4080-9676-081c1134c101" released by "_delete_snapshot" :: held 4.213s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:07:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e05bba3c-eebd-4ec3-9386-364d686a8615 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Lock "cinder-quobyte-c28d9a03-8125-49d5-8038-a115418bdf4c" released by "delete_snapshot" :: held 4.266s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:07:13 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-29b53c2b-3fc4-4e12-9fe9-1546b8b3c393 tempest-VolumesActionsTest-559339855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fb55c638-8ff4-4dcd-a507-6c57aa7833de" returned: 0 in 0.701s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-29b53c2b-3fc4-4e12-9fe9-1546b8b3c393 tempest-VolumesActionsTest-559339855 None] Lock "cinder-quobyte-fb55c638-8ff4-4dcd-a507-6c57aa7833de" released by "delete_volume" :: held 1.661s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:07:13 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-e05bba3c-eebd-4ec3-9386-364d686a8615 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Created reservations ['45a5651f-99cc-4b3f-852a-102860c4075d', '6c92b8d8-db6d-40e4-823c-d9e853b6a44a', '8f680bd1-5147-44dc-8c76-1c337b05de68', '0e5fe0dd-6656-453d-ad95-2952f4999ba6'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:07:13 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-29b53c2b-3fc4-4e12-9fe9-1546b8b3c393 tempest-VolumesActionsTest-559339855 None] Created reservations ['70b69763-faa8-4c1c-b0c7-69e721e75fc6', '6416331a-fd3a-4a48-b961-45bfa62ed643', '12c2b092-ea90-4b3a-9e34-14f00e7b51b4', '9f54dcd9-634b-42d7-a7eb-16efe8b1015f'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:07:13 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-e05bba3c-eebd-4ec3-9386-364d686a8615 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Delete snapshot completed successfully.
Jul 03 13:07:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e05bba3c-eebd-4ec3-9386-364d686a8615 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Lock "cinder-a1ae8891-4508-4080-9676-081c1134c101-delete_snapshot" released by "delete_snapshot" :: held 4.597s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:07:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-29b53c2b-3fc4-4e12-9fe9-1546b8b3c393 tempest-VolumesActionsTest-559339855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-29b53c2b-3fc4-4e12-9fe9-1546b8b3c393 tempest-VolumesActionsTest-559339855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:13 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-29b53c2b-3fc4-4e12-9fe9-1546b8b3c393 tempest-VolumesActionsTest-559339855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:07:13 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-29b53c2b-3fc4-4e12-9fe9-1546b8b3c393 tempest-VolumesActionsTest-559339855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:07:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-29b53c2b-3fc4-4e12-9fe9-1546b8b3c393 tempest-VolumesActionsTest-559339855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-29b53c2b-3fc4-4e12-9fe9-1546b8b3c393 tempest-VolumesActionsTest-559339855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:13 devstack sudo[95021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:07:13 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-956ceaed-c45e-4e7e-91be-7fb2e3383323 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Acquiring lock "cinder-c28d9a03-8125-49d5-8038-a115418bdf4c-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:07:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-956ceaed-c45e-4e7e-91be-7fb2e3383323 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Lock "cinder-c28d9a03-8125-49d5-8038-a115418bdf4c-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:07:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-956ceaed-c45e-4e7e-91be-7fb2e3383323 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Acquiring lock "cinder-quobyte-c28d9a03-8125-49d5-8038-a115418bdf4c" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:07:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-956ceaed-c45e-4e7e-91be-7fb2e3383323 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Lock "cinder-quobyte-c28d9a03-8125-49d5-8038-a115418bdf4c" acquired by "delete_volume" :: waited 0.044s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:07:14 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4986a4-cece-4437-8d39-0b20b4f5e25e]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-956ceaed-c45e-4e7e-91be-7fb2e3383323 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:07:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:07:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:07:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:15 devstack sudo[95099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:07:15 devstack sudo[95099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:15 devstack sudo[95098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c
Jul 03 13:07:15 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:15 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-29b53c2b-3fc4-4e12-9fe9-1546b8b3c393 tempest-VolumesActionsTest-559339855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.641s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:15 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-29b53c2b-3fc4-4e12-9fe9-1546b8b3c393 tempest-VolumesActionsTest-559339855 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:07:15 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-29b53c2b-3fc4-4e12-9fe9-1546b8b3c393 tempest-VolumesActionsTest-559339855 None] Deleted volume successfully.
Jul 03 13:07:15 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-29b53c2b-3fc4-4e12-9fe9-1546b8b3c393 tempest-VolumesActionsTest-559339855 None] Lock "cinder-fb55c638-8ff4-4dcd-a507-6c57aa7833de-delete_volume" released by "delete_volume" :: held 3.809s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:07:15 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:07:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Flow 'volume_create_manager' (664ce4c1-aaa3-4b8d-a7bc-ec3c1d217e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:07:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956b4606-85b8-4ea3-9118-c5f9295830f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956b4606-85b8-4ea3-9118-c5f9295830f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1341332857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac08157d-b8d5-4882-ae57-531ab645cc88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eecb317dca44a9a84c1fa43171306c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:16Z,use_quota=True,user_id='9e6e3c1ebb654d97bfc019c6ec7a4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1a87e3-7029-4ce0-815d-e917d0c0fe26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1a87e3-7029-4ce0-815d-e917d0c0fe26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ae651d-a399-446d-8528-c2aaae6c7d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ae651d-a399-446d-8528-c2aaae6c7d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac08157d-b8d5-4882-ae57-531ab645cc88', 'volume_name': 'volume-ac08157d-b8d5-4882-ae57-531ab645cc88', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d2f44f-08bd-4e17-a7a8-88415f414276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d2f44f-08bd-4e17-a7a8-88415f414276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3685af-f329-44cf-af06-345ea4164b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:15 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Volume ac08157d-b8d5-4882-ae57-531ab645cc88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac08157d-b8d5-4882-ae57-531ab645cc88', 'volume_size': 1}
Jul 03 13:07:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:15 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1341332857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac08157d-b8d5-4882-ae57-531ab645cc88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eecb317dca44a9a84c1fa43171306c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:16Z,use_quota=True,user_id='9e6e3c1ebb654d97bfc019c6ec7a4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:07:15 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Creating volume ac08157d-b8d5-4882-ae57-531ab645cc88 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:07:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:15 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:07:16 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:07:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:16 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:07:16 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:07:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ac08157d-b8d5-4882-ae57-531ab645cc88 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:16 devstack sudo[95109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ac08157d-b8d5-4882-ae57-531ab645cc88 1073741824
Jul 03 13:07:16 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:16 devstack sudo[95099]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.329s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:16 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:07:16 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:07:16 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 8 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:07:16 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:07:17 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-956ceaed-c45e-4e7e-91be-7fb2e3383323 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c" returned: 0 in 2.245s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-956ceaed-c45e-4e7e-91be-7fb2e3383323 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:17 devstack sudo[95116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c
Jul 03 13:07:17 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a8d7a9ff-4779-473b-baf1-7e9438120728 tempest-AttachVolumeNegativeTest-2100265475 None] Acquiring lock "cinder-a8d30da4-a307-4b70-9854-900a0bc02467-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:07:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a8d7a9ff-4779-473b-baf1-7e9438120728 tempest-AttachVolumeNegativeTest-2100265475 None] Lock "cinder-a8d30da4-a307-4b70-9854-900a0bc02467-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:07:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a8d7a9ff-4779-473b-baf1-7e9438120728 tempest-AttachVolumeNegativeTest-2100265475 None] Acquiring lock "cinder-quobyte-a8d30da4-a307-4b70-9854-900a0bc02467" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:07:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a8d7a9ff-4779-473b-baf1-7e9438120728 tempest-AttachVolumeNegativeTest-2100265475 None] Lock "cinder-quobyte-a8d30da4-a307-4b70-9854-900a0bc02467" acquired by "delete_volume" :: waited 0.031s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:07:17 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[762fa925-a8fe-40b2-848a-75df9b72f6c4]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a8d7a9ff-4779-473b-baf1-7e9438120728 tempest-AttachVolumeNegativeTest-2100265475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a8d30da4-a307-4b70-9854-900a0bc02467 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:17 devstack sudo[95119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a8d30da4-a307-4b70-9854-900a0bc02467
Jul 03 13:07:17 devstack sudo[95119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:17 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ac08157d-b8d5-4882-ae57-531ab645cc88 1073741824" returned: 0 in 1.762s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ac08157d-b8d5-4882-ae57-531ab645cc88 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:17 devstack sudo[95121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ac08157d-b8d5-4882-ae57-531ab645cc88
Jul 03 13:07:17 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:18 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-956ceaed-c45e-4e7e-91be-7fb2e3383323 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c28d9a03-8125-49d5-8038-a115418bdf4c" returned: 0 in 1.127s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:18 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-956ceaed-c45e-4e7e-91be-7fb2e3383323 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Lock "cinder-quobyte-c28d9a03-8125-49d5-8038-a115418bdf4c" released by "delete_volume" :: held 3.543s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:07:18 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-956ceaed-c45e-4e7e-91be-7fb2e3383323 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Created reservations ['02e17173-61fd-4839-9046-1ba4dce7d199', 'e234c622-9a76-42a9-ae2b-29c68fb3f727', 'c24dda63-cd89-452a-8dc8-63f17b903852', '52f8c96a-0278-4f93-b13d-94be16897e65'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:07:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-956ceaed-c45e-4e7e-91be-7fb2e3383323 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-956ceaed-c45e-4e7e-91be-7fb2e3383323 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:18 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-956ceaed-c45e-4e7e-91be-7fb2e3383323 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:07:18 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-956ceaed-c45e-4e7e-91be-7fb2e3383323 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:07:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-956ceaed-c45e-4e7e-91be-7fb2e3383323 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-956ceaed-c45e-4e7e-91be-7fb2e3383323 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:18 devstack sudo[95124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:07:18 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:18 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ac08157d-b8d5-4882-ae57-531ab645cc88" returned: 0 in 1.128s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:18 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] <== create_volume: return (2986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:07:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.994s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3685af-f329-44cf-af06-345ea4164b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac08157d-b8d5-4882-ae57-531ab645cc88', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f606e4-dd81-4d6b-97c1-abd31180bd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:19 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Volume volume-ac08157d-b8d5-4882-ae57-531ab645cc88 (ac08157d-b8d5-4882-ae57-531ab645cc88): created successfully
Jul 03 13:07:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f606e4-dd81-4d6b-97c1-abd31180bd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:19 devstack sudo[95119]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Flow 'volume_create_manager' (664ce4c1-aaa3-4b8d-a7bc-ec3c1d217e66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:07:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a8d7a9ff-4779-473b-baf1-7e9438120728 tempest-AttachVolumeNegativeTest-2100265475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a8d30da4-a307-4b70-9854-900a0bc02467" returned: 0 in 1.460s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a8d7a9ff-4779-473b-baf1-7e9438120728 tempest-AttachVolumeNegativeTest-2100265475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a8d30da4-a307-4b70-9854-900a0bc02467 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:19 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-6bc0b3f9-4240-434b-89e3-99f10e1afa3e tempest-VolumesActionsTest-907624772 None] Created volume successfully.
Jul 03 13:07:19 devstack sudo[95130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a8d30da4-a307-4b70-9854-900a0bc02467
Jul 03 13:07:19 devstack sudo[95130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:19 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-956ceaed-c45e-4e7e-91be-7fb2e3383323 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.074s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:19 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-956ceaed-c45e-4e7e-91be-7fb2e3383323 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:07:19 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-956ceaed-c45e-4e7e-91be-7fb2e3383323 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Deleted volume successfully.
Jul 03 13:07:19 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-956ceaed-c45e-4e7e-91be-7fb2e3383323 tempest-VolumesSnapshotNegativeTestJSON-1900033011 None] Lock "cinder-c28d9a03-8125-49d5-8038-a115418bdf4c-delete_volume" released by "delete_volume" :: held 5.229s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:07:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-69f45c5e-3dda-4f9d-aa09-12d8658fe9cf tempest-VolumesActionsTest-559339855 None] Acquiring lock "cinder-ac08157d-b8d5-4882-ae57-531ab645cc88-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:07:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-69f45c5e-3dda-4f9d-aa09-12d8658fe9cf tempest-VolumesActionsTest-559339855 None] Lock "cinder-ac08157d-b8d5-4882-ae57-531ab645cc88-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:07:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-69f45c5e-3dda-4f9d-aa09-12d8658fe9cf tempest-VolumesActionsTest-559339855 None] Acquiring lock "cinder-quobyte-ac08157d-b8d5-4882-ae57-531ab645cc88" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:07:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-69f45c5e-3dda-4f9d-aa09-12d8658fe9cf tempest-VolumesActionsTest-559339855 None] Lock "cinder-quobyte-ac08157d-b8d5-4882-ae57-531ab645cc88" acquired by "delete_volume" :: waited 0.039s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:07:20 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b51a94-fca9-4a11-8368-2eec6034de2a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-69f45c5e-3dda-4f9d-aa09-12d8658fe9cf tempest-VolumesActionsTest-559339855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ac08157d-b8d5-4882-ae57-531ab645cc88 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:20 devstack sudo[95130]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a8d7a9ff-4779-473b-baf1-7e9438120728 tempest-AttachVolumeNegativeTest-2100265475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a8d30da4-a307-4b70-9854-900a0bc02467" returned: 0 in 1.527s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a8d7a9ff-4779-473b-baf1-7e9438120728 tempest-AttachVolumeNegativeTest-2100265475 None] Lock "cinder-quobyte-a8d30da4-a307-4b70-9854-900a0bc02467" released by "delete_volume" :: held 3.076s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:07:20 devstack sudo[95135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ac08157d-b8d5-4882-ae57-531ab645cc88
Jul 03 13:07:20 devstack sudo[95135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:20 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-a8d7a9ff-4779-473b-baf1-7e9438120728 tempest-AttachVolumeNegativeTest-2100265475 None] Created reservations ['20bebc5d-9642-4377-9361-f0baa56ab110', '0dd145c7-dcc0-4e30-8c0b-9209166b6ce4', 'cdae0ef4-089c-4577-b611-ffb5ba951a81', '0914d697-52fd-470e-b239-cd7178fd2471'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:07:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a8d7a9ff-4779-473b-baf1-7e9438120728 tempest-AttachVolumeNegativeTest-2100265475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a8d7a9ff-4779-473b-baf1-7e9438120728 tempest-AttachVolumeNegativeTest-2100265475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:20 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a8d7a9ff-4779-473b-baf1-7e9438120728 tempest-AttachVolumeNegativeTest-2100265475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:07:20 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a8d7a9ff-4779-473b-baf1-7e9438120728 tempest-AttachVolumeNegativeTest-2100265475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:07:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a8d7a9ff-4779-473b-baf1-7e9438120728 tempest-AttachVolumeNegativeTest-2100265475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a8d7a9ff-4779-473b-baf1-7e9438120728 tempest-AttachVolumeNegativeTest-2100265475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:20 devstack sudo[95138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:07:20 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:21 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cd920244-25f4-4f34-af6d-c3bf007de0fa tempest-AttachVolumeNegativeTest-2100265475 None] Acquiring lock "cinder-80139456-8151-471c-a915-1508343f25d9-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:07:21 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cd920244-25f4-4f34-af6d-c3bf007de0fa tempest-AttachVolumeNegativeTest-2100265475 None] Lock "cinder-80139456-8151-471c-a915-1508343f25d9-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:07:21 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cd920244-25f4-4f34-af6d-c3bf007de0fa tempest-AttachVolumeNegativeTest-2100265475 None] Acquiring lock "cinder-quobyte-80139456-8151-471c-a915-1508343f25d9" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:07:21 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cd920244-25f4-4f34-af6d-c3bf007de0fa tempest-AttachVolumeNegativeTest-2100265475 None] Lock "cinder-quobyte-80139456-8151-471c-a915-1508343f25d9" acquired by "delete_volume" :: waited 0.035s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:07:21 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ae3ca2-cf01-4307-8c25-99a1483f0408]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cd920244-25f4-4f34-af6d-c3bf007de0fa tempest-AttachVolumeNegativeTest-2100265475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-80139456-8151-471c-a915-1508343f25d9 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:21 devstack sudo[95143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-80139456-8151-471c-a915-1508343f25d9
Jul 03 13:07:21 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:22 devstack sudo[95135]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-69f45c5e-3dda-4f9d-aa09-12d8658fe9cf tempest-VolumesActionsTest-559339855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ac08157d-b8d5-4882-ae57-531ab645cc88" returned: 0 in 2.003s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-69f45c5e-3dda-4f9d-aa09-12d8658fe9cf tempest-VolumesActionsTest-559339855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ac08157d-b8d5-4882-ae57-531ab645cc88 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:22 devstack sudo[95153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ac08157d-b8d5-4882-ae57-531ab645cc88
Jul 03 13:07:22 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:22 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a8d7a9ff-4779-473b-baf1-7e9438120728 tempest-AttachVolumeNegativeTest-2100265475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.969s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:22 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-a8d7a9ff-4779-473b-baf1-7e9438120728 tempest-AttachVolumeNegativeTest-2100265475 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:07:22 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-a8d7a9ff-4779-473b-baf1-7e9438120728 tempest-AttachVolumeNegativeTest-2100265475 None] Deleted volume successfully.
Jul 03 13:07:22 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a8d7a9ff-4779-473b-baf1-7e9438120728 tempest-AttachVolumeNegativeTest-2100265475 None] Lock "cinder-a8d30da4-a307-4b70-9854-900a0bc02467-delete_volume" released by "delete_volume" :: held 5.483s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:07:23 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cd920244-25f4-4f34-af6d-c3bf007de0fa tempest-AttachVolumeNegativeTest-2100265475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-80139456-8151-471c-a915-1508343f25d9" returned: 0 in 1.794s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cd920244-25f4-4f34-af6d-c3bf007de0fa tempest-AttachVolumeNegativeTest-2100265475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-80139456-8151-471c-a915-1508343f25d9 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:23 devstack sudo[95159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-80139456-8151-471c-a915-1508343f25d9
Jul 03 13:07:23 devstack sudo[95159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:23 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-69f45c5e-3dda-4f9d-aa09-12d8658fe9cf tempest-VolumesActionsTest-559339855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ac08157d-b8d5-4882-ae57-531ab645cc88" returned: 0 in 1.101s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-69f45c5e-3dda-4f9d-aa09-12d8658fe9cf tempest-VolumesActionsTest-559339855 None] Lock "cinder-quobyte-ac08157d-b8d5-4882-ae57-531ab645cc88" released by "delete_volume" :: held 3.201s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:07:23 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-69f45c5e-3dda-4f9d-aa09-12d8658fe9cf tempest-VolumesActionsTest-559339855 None] Created reservations ['a25cd29a-708f-4de2-ae6f-7255ed935866', '47b09800-c633-4fb2-8a97-8e4ed545bba9', '5195632f-300b-4e46-9925-9939a1120ceb', 'bcdb710d-2e03-4c4c-970c-931c1503724c'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:07:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-69f45c5e-3dda-4f9d-aa09-12d8658fe9cf tempest-VolumesActionsTest-559339855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-69f45c5e-3dda-4f9d-aa09-12d8658fe9cf tempest-VolumesActionsTest-559339855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-69f45c5e-3dda-4f9d-aa09-12d8658fe9cf tempest-VolumesActionsTest-559339855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:07:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-69f45c5e-3dda-4f9d-aa09-12d8658fe9cf tempest-VolumesActionsTest-559339855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:07:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-69f45c5e-3dda-4f9d-aa09-12d8658fe9cf tempest-VolumesActionsTest-559339855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-69f45c5e-3dda-4f9d-aa09-12d8658fe9cf tempest-VolumesActionsTest-559339855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:24 devstack sudo[95162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:07:24 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:24 devstack sudo[95159]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cd920244-25f4-4f34-af6d-c3bf007de0fa tempest-AttachVolumeNegativeTest-2100265475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-80139456-8151-471c-a915-1508343f25d9" returned: 0 in 1.086s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cd920244-25f4-4f34-af6d-c3bf007de0fa tempest-AttachVolumeNegativeTest-2100265475 None] Lock "cinder-quobyte-80139456-8151-471c-a915-1508343f25d9" released by "delete_volume" :: held 2.976s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:07:24 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-cd920244-25f4-4f34-af6d-c3bf007de0fa tempest-AttachVolumeNegativeTest-2100265475 None] Created reservations ['46e0dbf5-8265-45f8-9b48-cdb1fa6be928', '3bb2e42b-0aa2-4c36-a225-2486884dbec4', 'a580a672-c53c-4ea9-935e-ee3861670d12', '5f66903a-afd1-476e-8b6e-52eddb076deb'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:07:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cd920244-25f4-4f34-af6d-c3bf007de0fa tempest-AttachVolumeNegativeTest-2100265475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cd920244-25f4-4f34-af6d-c3bf007de0fa tempest-AttachVolumeNegativeTest-2100265475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-cd920244-25f4-4f34-af6d-c3bf007de0fa tempest-AttachVolumeNegativeTest-2100265475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:07:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-cd920244-25f4-4f34-af6d-c3bf007de0fa tempest-AttachVolumeNegativeTest-2100265475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:07:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cd920244-25f4-4f34-af6d-c3bf007de0fa tempest-AttachVolumeNegativeTest-2100265475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cd920244-25f4-4f34-af6d-c3bf007de0fa tempest-AttachVolumeNegativeTest-2100265475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:24 devstack sudo[95165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:07:24 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:25 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-69f45c5e-3dda-4f9d-aa09-12d8658fe9cf tempest-VolumesActionsTest-559339855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.199s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:25 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-69f45c5e-3dda-4f9d-aa09-12d8658fe9cf tempest-VolumesActionsTest-559339855 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:07:25 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-69f45c5e-3dda-4f9d-aa09-12d8658fe9cf tempest-VolumesActionsTest-559339855 None] Deleted volume successfully.
Jul 03 13:07:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-69f45c5e-3dda-4f9d-aa09-12d8658fe9cf tempest-VolumesActionsTest-559339855 None] Lock "cinder-ac08157d-b8d5-4882-ae57-531ab645cc88-delete_volume" released by "delete_volume" :: held 5.012s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:07:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1b5f6da3-939d-46c7-b9dd-ea475640d639 tempest-AttachVolumeNegativeTest-2100265475 None] Acquiring lock "cinder-c6054761-77fc-4e51-91fe-f49d1caaff41-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:07:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1b5f6da3-939d-46c7-b9dd-ea475640d639 tempest-AttachVolumeNegativeTest-2100265475 None] Lock "cinder-c6054761-77fc-4e51-91fe-f49d1caaff41-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:07:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1b5f6da3-939d-46c7-b9dd-ea475640d639 tempest-AttachVolumeNegativeTest-2100265475 None] Acquiring lock "cinder-quobyte-c6054761-77fc-4e51-91fe-f49d1caaff41" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:07:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1b5f6da3-939d-46c7-b9dd-ea475640d639 tempest-AttachVolumeNegativeTest-2100265475 None] Lock "cinder-quobyte-c6054761-77fc-4e51-91fe-f49d1caaff41" acquired by "delete_volume" :: waited 0.071s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:07:25 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68ef6a0-f913-4187-9c64-7cb8fba8fa8d]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1b5f6da3-939d-46c7-b9dd-ea475640d639 tempest-AttachVolumeNegativeTest-2100265475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c6054761-77fc-4e51-91fe-f49d1caaff41 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:25 devstack sudo[95168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c6054761-77fc-4e51-91fe-f49d1caaff41
Jul 03 13:07:25 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:25 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cd920244-25f4-4f34-af6d-c3bf007de0fa tempest-AttachVolumeNegativeTest-2100265475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.422s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:25 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-cd920244-25f4-4f34-af6d-c3bf007de0fa tempest-AttachVolumeNegativeTest-2100265475 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:07:25 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-cd920244-25f4-4f34-af6d-c3bf007de0fa tempest-AttachVolumeNegativeTest-2100265475 None] Deleted volume successfully.
Jul 03 13:07:26 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cd920244-25f4-4f34-af6d-c3bf007de0fa tempest-AttachVolumeNegativeTest-2100265475 None] Lock "cinder-80139456-8151-471c-a915-1508343f25d9-delete_volume" released by "delete_volume" :: held 4.736s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:07:26 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:07:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Flow 'volume_create_manager' (b465a033-d17d-47aa-98f1-30b09033cc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:07:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (350ea05f-56cd-4660-8d5b-b8c945a08346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (350ea05f-56cd-4660-8d5b-b8c945a08346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1726718860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0063a578-a66b-4e47-b880-12ad41be0d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eecb317dca44a9a84c1fa43171306c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:26Z,use_quota=True,user_id='9e6e3c1ebb654d97bfc019c6ec7a4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (582996a8-e326-4b50-8a99-40d665403304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (582996a8-e326-4b50-8a99-40d665403304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b2aa75-1dbd-4323-b61c-c0a2c77cbb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b2aa75-1dbd-4323-b61c-c0a2c77cbb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0063a578-a66b-4e47-b880-12ad41be0d56', 'volume_name': 'volume-0063a578-a66b-4e47-b880-12ad41be0d56', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a101345-e057-4758-b756-2519bec4eb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a101345-e057-4758-b756-2519bec4eb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf378166-9599-4e51-8dd8-af9db4740654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:26 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Volume 0063a578-a66b-4e47-b880-12ad41be0d56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0063a578-a66b-4e47-b880-12ad41be0d56', 'volume_size': 1}
Jul 03 13:07:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1726718860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0063a578-a66b-4e47-b880-12ad41be0d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eecb317dca44a9a84c1fa43171306c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:26Z,use_quota=True,user_id='9e6e3c1ebb654d97bfc019c6ec7a4248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:07:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Creating volume 0063a578-a66b-4e47-b880-12ad41be0d56 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:07:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:07:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:07:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:07:26 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:07:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-0063a578-a66b-4e47-b880-12ad41be0d56 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:26 devstack sudo[95171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-0063a578-a66b-4e47-b880-12ad41be0d56 1073741824
Jul 03 13:07:26 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:27 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1b5f6da3-939d-46c7-b9dd-ea475640d639 tempest-AttachVolumeNegativeTest-2100265475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c6054761-77fc-4e51-91fe-f49d1caaff41" returned: 0 in 1.730s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1b5f6da3-939d-46c7-b9dd-ea475640d639 tempest-AttachVolumeNegativeTest-2100265475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c6054761-77fc-4e51-91fe-f49d1caaff41 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:27 devstack sudo[95176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c6054761-77fc-4e51-91fe-f49d1caaff41
Jul 03 13:07:27 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:27 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-0063a578-a66b-4e47-b880-12ad41be0d56 1073741824" returned: 0 in 1.387s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-0063a578-a66b-4e47-b880-12ad41be0d56 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:27 devstack sudo[95183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-0063a578-a66b-4e47-b880-12ad41be0d56
Jul 03 13:07:27 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:28 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1b5f6da3-939d-46c7-b9dd-ea475640d639 tempest-AttachVolumeNegativeTest-2100265475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c6054761-77fc-4e51-91fe-f49d1caaff41" returned: 0 in 0.829s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:28 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1b5f6da3-939d-46c7-b9dd-ea475640d639 tempest-AttachVolumeNegativeTest-2100265475 None] Lock "cinder-quobyte-c6054761-77fc-4e51-91fe-f49d1caaff41" released by "delete_volume" :: held 2.655s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:07:28 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-1b5f6da3-939d-46c7-b9dd-ea475640d639 tempest-AttachVolumeNegativeTest-2100265475 None] Created reservations ['be1d9343-d8bf-4d01-910f-3303a8dad533', 'f420ac29-d875-4739-a017-870a9f5763bd', 'a486ddc5-37a1-4f65-92ac-0187fb497c23', 'cc77988f-8a07-49dd-9989-17241894dacc'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:07:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1b5f6da3-939d-46c7-b9dd-ea475640d639 tempest-AttachVolumeNegativeTest-2100265475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1b5f6da3-939d-46c7-b9dd-ea475640d639 tempest-AttachVolumeNegativeTest-2100265475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:28 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1b5f6da3-939d-46c7-b9dd-ea475640d639 tempest-AttachVolumeNegativeTest-2100265475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:07:28 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1b5f6da3-939d-46c7-b9dd-ea475640d639 tempest-AttachVolumeNegativeTest-2100265475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:07:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1b5f6da3-939d-46c7-b9dd-ea475640d639 tempest-AttachVolumeNegativeTest-2100265475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1b5f6da3-939d-46c7-b9dd-ea475640d639 tempest-AttachVolumeNegativeTest-2100265475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:28 devstack sudo[95187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:07:28 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:28 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-0063a578-a66b-4e47-b880-12ad41be0d56" returned: 0 in 1.062s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:28 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] <== create_volume: return (2521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:07:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.524s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf378166-9599-4e51-8dd8-af9db4740654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0063a578-a66b-4e47-b880-12ad41be0d56', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e672c39a-6107-4a2b-9a82-22f947bd1543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:29 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Volume volume-0063a578-a66b-4e47-b880-12ad41be0d56 (0063a578-a66b-4e47-b880-12ad41be0d56): created successfully
Jul 03 13:07:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e672c39a-6107-4a2b-9a82-22f947bd1543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Flow 'volume_create_manager' (b465a033-d17d-47aa-98f1-30b09033cc30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:07:29 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-33d33576-1d55-4eff-8461-31a9438eabac tempest-VolumesActionsTest-907624772 None] Created volume successfully.
Jul 03 13:07:29 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1b5f6da3-939d-46c7-b9dd-ea475640d639 tempest-AttachVolumeNegativeTest-2100265475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.191s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:29 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-1b5f6da3-939d-46c7-b9dd-ea475640d639 tempest-AttachVolumeNegativeTest-2100265475 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:07:29 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-1b5f6da3-939d-46c7-b9dd-ea475640d639 tempest-AttachVolumeNegativeTest-2100265475 None] Deleted volume successfully.
Jul 03 13:07:29 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1b5f6da3-939d-46c7-b9dd-ea475640d639 tempest-AttachVolumeNegativeTest-2100265475 None] Lock "cinder-c6054761-77fc-4e51-91fe-f49d1caaff41-delete_volume" released by "delete_volume" :: held 4.289s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:07:30 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b0492e55-7538-4c3e-a7d6-002f5cd32700 tempest-VolumesActionsTest-907624772 None] Acquiring lock "cinder-0063a578-a66b-4e47-b880-12ad41be0d56-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:07:30 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b0492e55-7538-4c3e-a7d6-002f5cd32700 tempest-VolumesActionsTest-907624772 None] Lock "cinder-0063a578-a66b-4e47-b880-12ad41be0d56-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:07:30 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b0492e55-7538-4c3e-a7d6-002f5cd32700 tempest-VolumesActionsTest-907624772 None] Acquiring lock "cinder-quobyte-0063a578-a66b-4e47-b880-12ad41be0d56" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:07:30 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b0492e55-7538-4c3e-a7d6-002f5cd32700 tempest-VolumesActionsTest-907624772 None] Lock "cinder-quobyte-0063a578-a66b-4e47-b880-12ad41be0d56" acquired by "delete_volume" :: waited 0.019s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:07:30 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5259319a-aeca-487b-8bec-e3b4d9354fe6]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b0492e55-7538-4c3e-a7d6-002f5cd32700 tempest-VolumesActionsTest-907624772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-0063a578-a66b-4e47-b880-12ad41be0d56 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:30 devstack sudo[95208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-0063a578-a66b-4e47-b880-12ad41be0d56
Jul 03 13:07:30 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:31 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b0492e55-7538-4c3e-a7d6-002f5cd32700 tempest-VolumesActionsTest-907624772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-0063a578-a66b-4e47-b880-12ad41be0d56" returned: 0 in 1.051s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b0492e55-7538-4c3e-a7d6-002f5cd32700 tempest-VolumesActionsTest-907624772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-0063a578-a66b-4e47-b880-12ad41be0d56 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:31 devstack sudo[95214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-0063a578-a66b-4e47-b880-12ad41be0d56
Jul 03 13:07:31 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:32 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b0492e55-7538-4c3e-a7d6-002f5cd32700 tempest-VolumesActionsTest-907624772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-0063a578-a66b-4e47-b880-12ad41be0d56" returned: 0 in 1.049s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:32 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b0492e55-7538-4c3e-a7d6-002f5cd32700 tempest-VolumesActionsTest-907624772 None] Lock "cinder-quobyte-0063a578-a66b-4e47-b880-12ad41be0d56" released by "delete_volume" :: held 2.174s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:07:32 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-b0492e55-7538-4c3e-a7d6-002f5cd32700 tempest-VolumesActionsTest-907624772 None] Created reservations ['1fc24ec8-ea5e-4ebe-b1ae-abdaf2b75f6e', '0c032d7e-f856-4be0-b578-96012556f7e2', 'ec9dacc9-9991-4852-8844-3d3bf9a2da1c', '3ed25d0f-f31c-486d-84d4-699021ffbc5e'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:07:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b0492e55-7538-4c3e-a7d6-002f5cd32700 tempest-VolumesActionsTest-907624772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b0492e55-7538-4c3e-a7d6-002f5cd32700 tempest-VolumesActionsTest-907624772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b0492e55-7538-4c3e-a7d6-002f5cd32700 tempest-VolumesActionsTest-907624772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:07:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b0492e55-7538-4c3e-a7d6-002f5cd32700 tempest-VolumesActionsTest-907624772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:07:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b0492e55-7538-4c3e-a7d6-002f5cd32700 tempest-VolumesActionsTest-907624772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b0492e55-7538-4c3e-a7d6-002f5cd32700 tempest-VolumesActionsTest-907624772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:32 devstack sudo[95218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:07:32 devstack sudo[95218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:33 devstack sudo[95218]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b0492e55-7538-4c3e-a7d6-002f5cd32700 tempest-VolumesActionsTest-907624772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.997s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:33 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-b0492e55-7538-4c3e-a7d6-002f5cd32700 tempest-VolumesActionsTest-907624772 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:07:33 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-b0492e55-7538-4c3e-a7d6-002f5cd32700 tempest-VolumesActionsTest-907624772 None] Deleted volume successfully.
Jul 03 13:07:33 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b0492e55-7538-4c3e-a7d6-002f5cd32700 tempest-VolumesActionsTest-907624772 None] Lock "cinder-0063a578-a66b-4e47-b880-12ad41be0d56-delete_volume" released by "delete_volume" :: held 3.530s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:07:42 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=59,cinder:INSERT=32,cinder:UPDATE=112,cinder:DELETE=8 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:07:43 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:07:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Flow 'volume_create_manager' (d4d66ca1-bbcb-4374-90ad-99ac871658c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:07:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc149d7b-072e-41e6-b67e-4d86655ea49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc149d7b-072e-41e6-b67e-4d86655ea49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1263658191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=783c0a8d-6179-4abd-b50d-bbb69259fd2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a53b8c83c4342578010aeced7d6db52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:44Z,use_quota=True,user_id='20c01da34cf44404bed466cb2b241407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94363472-26da-4340-b0ba-47adfb633afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94363472-26da-4340-b0ba-47adfb633afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec26a75-3366-4794-93ee-3e4a115dc94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec26a75-3366-4794-93ee-3e4a115dc94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '783c0a8d-6179-4abd-b50d-bbb69259fd2f', 'volume_name': 'volume-783c0a8d-6179-4abd-b50d-bbb69259fd2f', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (315aeaff-6c79-4bee-80db-ddbf7ad0cd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (315aeaff-6c79-4bee-80db-ddbf7ad0cd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca8a47a-07d5-481b-9887-63f1b23a0380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:44 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Volume 783c0a8d-6179-4abd-b50d-bbb69259fd2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-783c0a8d-6179-4abd-b50d-bbb69259fd2f', 'volume_size': 1}
Jul 03 13:07:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1263658191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=783c0a8d-6179-4abd-b50d-bbb69259fd2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a53b8c83c4342578010aeced7d6db52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:44Z,use_quota=True,user_id='20c01da34cf44404bed466cb2b241407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:07:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Creating volume 783c0a8d-6179-4abd-b50d-bbb69259fd2f {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:07:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:07:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:07:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:07:44 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:07:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-783c0a8d-6179-4abd-b50d-bbb69259fd2f 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:44 devstack sudo[95232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-783c0a8d-6179-4abd-b50d-bbb69259fd2f 1073741824
Jul 03 13:07:44 devstack sudo[95232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:44 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:07:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Flow 'volume_create_manager' (b8ec2f97-2478-41ad-a43f-f6ee3ee8c643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:07:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb9e7239-121c-4785-8769-991c4e5f5fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb9e7239-121c-4785-8769-991c4e5f5fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1139922290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73aa988d-1671-4570-8194-3ef504472b7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2bc8129a5c34efb8f9615bc872723d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:44Z,use_quota=True,user_id='a0652166dd37469893ebac1a63649695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (230889bc-6f00-4101-8df9-0ab58c4bdb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (230889bc-6f00-4101-8df9-0ab58c4bdb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5888496f-4471-4e38-9698-ca3403441f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5888496f-4471-4e38-9698-ca3403441f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73aa988d-1671-4570-8194-3ef504472b7c', 'volume_name': 'volume-73aa988d-1671-4570-8194-3ef504472b7c', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a38baa-aa8b-49ad-9029-46887112ee21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a38baa-aa8b-49ad-9029-46887112ee21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97cab987-2bff-49a7-b87e-61573c668cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:44 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Volume 73aa988d-1671-4570-8194-3ef504472b7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73aa988d-1671-4570-8194-3ef504472b7c', 'volume_size': 1}
Jul 03 13:07:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:45 devstack sudo[95232]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-783c0a8d-6179-4abd-b50d-bbb69259fd2f 1073741824" returned: 0 in 1.134s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-783c0a8d-6179-4abd-b50d-bbb69259fd2f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:45 devstack sudo[95238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-783c0a8d-6179-4abd-b50d-bbb69259fd2f
Jul 03 13:07:45 devstack sudo[95238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:46 devstack sudo[95238]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-783c0a8d-6179-4abd-b50d-bbb69259fd2f" returned: 0 in 1.040s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:46 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] <== create_volume: return (2254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:07:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.257s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.970s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:46 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1139922290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73aa988d-1671-4570-8194-3ef504472b7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2bc8129a5c34efb8f9615bc872723d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:44Z,use_quota=True,user_id='a0652166dd37469893ebac1a63649695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:07:46 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Creating volume 73aa988d-1671-4570-8194-3ef504472b7c {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:07:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:46 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:07:46 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:07:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:46 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:07:46 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:07:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:46 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca8a47a-07d5-481b-9887-63f1b23a0380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-783c0a8d-6179-4abd-b50d-bbb69259fd2f', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:46 devstack sudo[95241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c 1073741824
Jul 03 13:07:46 devstack sudo[95241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:46 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edc7a53b-bc10-43d5-9eef-abe3c77ff1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:46 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Volume volume-783c0a8d-6179-4abd-b50d-bbb69259fd2f (783c0a8d-6179-4abd-b50d-bbb69259fd2f): created successfully
Jul 03 13:07:46 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edc7a53b-bc10-43d5-9eef-abe3c77ff1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:46 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Flow 'volume_create_manager' (d4d66ca1-bbcb-4374-90ad-99ac871658c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:07:46 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-37cd8dc5-91b3-42d7-9192-e4e087b7ca5f tempest-AttachVolumeTestJSON-933021987 None] Created volume successfully.
Jul 03 13:07:46 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=108,cinder:INSERT=24,cinder:UPDATE=113,cinder:DELETE=11 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:07:47 devstack sudo[95241]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c 1073741824" returned: 0 in 1.573s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:47 devstack sudo[95250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c
Jul 03 13:07:47 devstack sudo[95250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:48 devstack sudo[95250]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c" returned: 0 in 0.944s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:48 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] <== create_volume: return (2597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:07:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.602s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:48 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97cab987-2bff-49a7-b87e-61573c668cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73aa988d-1671-4570-8194-3ef504472b7c', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:48 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c86970-1d9e-409b-b4c6-3cde6ccfeb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:48 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Volume volume-73aa988d-1671-4570-8194-3ef504472b7c (73aa988d-1671-4570-8194-3ef504472b7c): created successfully
Jul 03 13:07:48 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c86970-1d9e-409b-b4c6-3cde6ccfeb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:48 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Flow 'volume_create_manager' (b8ec2f97-2478-41ad-a43f-f6ee3ee8c643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:07:48 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-3d191ad9-d569-4764-bc89-e65547631c22 req-3cc01d52-e638-48dc-ad6b-6534cb013e97 tempest-VolumesSnapshotsTestJSON-1909492351 None] Created volume successfully.
Jul 03 13:07:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-820ac10c-5ba0-4de1-a225-f3db8aa7e3c2 req-72ba178a-5562-4a5f-a66f-b3ad5a59c989 tempest-VolumesSnapshotsTestJSON-1909492351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-820ac10c-5ba0-4de1-a225-f3db8aa7e3c2 req-72ba178a-5562-4a5f-a66f-b3ad5a59c989 tempest-VolumesSnapshotsTestJSON-1909492351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [req-820ac10c-5ba0-4de1-a225-f3db8aa7e3c2 req-72ba178a-5562-4a5f-a66f-b3ad5a59c989 tempest-VolumesSnapshotsTestJSON-1909492351 None] Creating offline snapshot a24afcad-869f-4cfc-8bf1-3ee244f5a5b1 of volume 73aa988d-1671-4570-8194-3ef504472b7c {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:07:49 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d48586-220d-41ae-a14b-623c5451edb1]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-820ac10c-5ba0-4de1-a225-f3db8aa7e3c2 req-72ba178a-5562-4a5f-a66f-b3ad5a59c989 tempest-VolumesSnapshotsTestJSON-1909492351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:49 devstack sudo[95257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c
Jul 03 13:07:49 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:51 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-820ac10c-5ba0-4de1-a225-f3db8aa7e3c2 req-72ba178a-5562-4a5f-a66f-b3ad5a59c989 tempest-VolumesSnapshotsTestJSON-1909492351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c" returned: 0 in 1.260s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-820ac10c-5ba0-4de1-a225-f3db8aa7e3c2 req-72ba178a-5562-4a5f-a66f-b3ad5a59c989 tempest-VolumesSnapshotsTestJSON-1909492351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c.a24afcad-869f-4cfc-8bf1-3ee244f5a5b1 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:51 devstack sudo[95264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c.a24afcad-869f-4cfc-8bf1-3ee244f5a5b1 1G
Jul 03 13:07:51 devstack sudo[95264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-15c8cefa-0217-4d91-957d-96ff256911fb req-cca3cbc9-9db8-42e0-b146-48fecab3b0c3 tempest-AttachVolumeTestJSON-933021987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:07:52 devstack sudo[95264]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-820ac10c-5ba0-4de1-a225-f3db8aa7e3c2 req-72ba178a-5562-4a5f-a66f-b3ad5a59c989 tempest-VolumesSnapshotsTestJSON-1909492351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c.a24afcad-869f-4cfc-8bf1-3ee244f5a5b1 1G" returned: 0 in 1.180s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-820ac10c-5ba0-4de1-a225-f3db8aa7e3c2 req-72ba178a-5562-4a5f-a66f-b3ad5a59c989 tempest-VolumesSnapshotsTestJSON-1909492351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73aa988d-1671-4570-8194-3ef504472b7c -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c.a24afcad-869f-4cfc-8bf1-3ee244f5a5b1 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:52 devstack sudo[95279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73aa988d-1671-4570-8194-3ef504472b7c -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c.a24afcad-869f-4cfc-8bf1-3ee244f5a5b1
Jul 03 13:07:52 devstack sudo[95279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:53 devstack sudo[95279]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-820ac10c-5ba0-4de1-a225-f3db8aa7e3c2 req-72ba178a-5562-4a5f-a66f-b3ad5a59c989 tempest-VolumesSnapshotsTestJSON-1909492351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73aa988d-1671-4570-8194-3ef504472b7c -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c.a24afcad-869f-4cfc-8bf1-3ee244f5a5b1" returned: 0 in 1.122s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:53 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [req-820ac10c-5ba0-4de1-a225-f3db8aa7e3c2 req-72ba178a-5562-4a5f-a66f-b3ad5a59c989 tempest-VolumesSnapshotsTestJSON-1909492351 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c.a24afcad-869f-4cfc-8bf1-3ee244f5a5b1 is being set with open permissions: ugo+rw
Jul 03 13:07:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-820ac10c-5ba0-4de1-a225-f3db8aa7e3c2 req-72ba178a-5562-4a5f-a66f-b3ad5a59c989 tempest-VolumesSnapshotsTestJSON-1909492351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c.a24afcad-869f-4cfc-8bf1-3ee244f5a5b1 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:53 devstack sudo[95292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c.a24afcad-869f-4cfc-8bf1-3ee244f5a5b1
Jul 03 13:07:53 devstack sudo[95292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:54 devstack sudo[95292]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-820ac10c-5ba0-4de1-a225-f3db8aa7e3c2 req-72ba178a-5562-4a5f-a66f-b3ad5a59c989 tempest-VolumesSnapshotsTestJSON-1909492351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c.a24afcad-869f-4cfc-8bf1-3ee244f5a5b1" returned: 0 in 0.871s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-820ac10c-5ba0-4de1-a225-f3db8aa7e3c2 req-72ba178a-5562-4a5f-a66f-b3ad5a59c989 tempest-VolumesSnapshotsTestJSON-1909492351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:54 devstack sudo[95295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c.info
Jul 03 13:07:54 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:55 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-820ac10c-5ba0-4de1-a225-f3db8aa7e3c2 req-72ba178a-5562-4a5f-a66f-b3ad5a59c989 tempest-VolumesSnapshotsTestJSON-1909492351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c.info" returned: 0 in 0.941s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:55 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [req-820ac10c-5ba0-4de1-a225-f3db8aa7e3c2 req-72ba178a-5562-4a5f-a66f-b3ad5a59c989 tempest-VolumesSnapshotsTestJSON-1909492351 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c.info is being set with open permissions: ugo+rw
Jul 03 13:07:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-820ac10c-5ba0-4de1-a225-f3db8aa7e3c2 req-72ba178a-5562-4a5f-a66f-b3ad5a59c989 tempest-VolumesSnapshotsTestJSON-1909492351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:55 devstack sudo[95298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c.info
Jul 03 13:07:55 devstack sudo[95298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:56 devstack sudo[95298]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-820ac10c-5ba0-4de1-a225-f3db8aa7e3c2 req-72ba178a-5562-4a5f-a66f-b3ad5a59c989 tempest-VolumesSnapshotsTestJSON-1909492351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c.info" returned: 0 in 0.948s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-820ac10c-5ba0-4de1-a225-f3db8aa7e3c2 req-72ba178a-5562-4a5f-a66f-b3ad5a59c989 tempest-VolumesSnapshotsTestJSON-1909492351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.478s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-15c8cefa-0217-4d91-957d-96ff256911fb req-cca3cbc9-9db8-42e0-b146-48fecab3b0c3 tempest-AttachVolumeTestJSON-933021987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.479s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:07:56 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[94892815-0931-46ce-a3cd-a13c5a828bbf]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-15c8cefa-0217-4d91-957d-96ff256911fb req-cca3cbc9-9db8-42e0-b146-48fecab3b0c3 tempest-AttachVolumeTestJSON-933021987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-783c0a8d-6179-4abd-b50d-bbb69259fd2f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:56 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-820ac10c-5ba0-4de1-a225-f3db8aa7e3c2 req-72ba178a-5562-4a5f-a66f-b3ad5a59c989 tempest-VolumesSnapshotsTestJSON-1909492351 None] Create snapshot completed successfully
Jul 03 13:07:56 devstack sudo[95301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-783c0a8d-6179-4abd-b50d-bbb69259fd2f
Jul 03 13:07:56 devstack sudo[95301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:56 devstack cinder-volume[86837]: DEBUG cinder.coordination [req-cf153b38-1d29-43d4-a397-d85e246162e6 req-7b6f112d-3a3f-4263-87f6-f6b16727e4e9 tempest-VolumesSnapshotsTestJSON-1909492351 None] Acquiring lock "cinder-a24afcad-869f-4cfc-8bf1-3ee244f5a5b1-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:07:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [req-cf153b38-1d29-43d4-a397-d85e246162e6 req-7b6f112d-3a3f-4263-87f6-f6b16727e4e9 tempest-VolumesSnapshotsTestJSON-1909492351 None] Lock "cinder-a24afcad-869f-4cfc-8bf1-3ee244f5a5b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:07:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [req-cf153b38-1d29-43d4-a397-d85e246162e6 req-7b6f112d-3a3f-4263-87f6-f6b16727e4e9 tempest-VolumesSnapshotsTestJSON-1909492351 None] Acquiring lock "cinder-quobyte-73aa988d-1671-4570-8194-3ef504472b7c" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:07:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [req-cf153b38-1d29-43d4-a397-d85e246162e6 req-7b6f112d-3a3f-4263-87f6-f6b16727e4e9 tempest-VolumesSnapshotsTestJSON-1909492351 None] Lock "cinder-quobyte-73aa988d-1671-4570-8194-3ef504472b7c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:07:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [req-cf153b38-1d29-43d4-a397-d85e246162e6 req-7b6f112d-3a3f-4263-87f6-f6b16727e4e9 tempest-VolumesSnapshotsTestJSON-1909492351 None] Acquiring lock "cinder-quobyte-a24afcad-869f-4cfc-8bf1-3ee244f5a5b1" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:07:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [req-cf153b38-1d29-43d4-a397-d85e246162e6 req-7b6f112d-3a3f-4263-87f6-f6b16727e4e9 tempest-VolumesSnapshotsTestJSON-1909492351 None] Lock "cinder-quobyte-a24afcad-869f-4cfc-8bf1-3ee244f5a5b1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:07:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [req-cf153b38-1d29-43d4-a397-d85e246162e6 req-7b6f112d-3a3f-4263-87f6-f6b16727e4e9 tempest-VolumesSnapshotsTestJSON-1909492351 None] Deleting offline snapshot a24afcad-869f-4cfc-8bf1-3ee244f5a5b1 of volume 73aa988d-1671-4570-8194-3ef504472b7c {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:07:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [req-cf153b38-1d29-43d4-a397-d85e246162e6 req-7b6f112d-3a3f-4263-87f6-f6b16727e4e9 tempest-VolumesSnapshotsTestJSON-1909492351 None] snapshot_file for this snap is: volume-73aa988d-1671-4570-8194-3ef504472b7c.a24afcad-869f-4cfc-8bf1-3ee244f5a5b1 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:07:57 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2d659d-9adc-4ff3-be15-3369cb5b043c]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-cf153b38-1d29-43d4-a397-d85e246162e6 req-7b6f112d-3a3f-4263-87f6-f6b16727e4e9 tempest-VolumesSnapshotsTestJSON-1909492351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c.a24afcad-869f-4cfc-8bf1-3ee244f5a5b1 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:57 devstack sudo[95303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c.a24afcad-869f-4cfc-8bf1-3ee244f5a5b1
Jul 03 13:07:57 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:57 devstack sudo[95301]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-15c8cefa-0217-4d91-957d-96ff256911fb req-cca3cbc9-9db8-42e0-b146-48fecab3b0c3 tempest-AttachVolumeTestJSON-933021987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-783c0a8d-6179-4abd-b50d-bbb69259fd2f" returned: 0 in 1.194s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-15c8cefa-0217-4d91-957d-96ff256911fb req-cca3cbc9-9db8-42e0-b146-48fecab3b0c3 tempest-AttachVolumeTestJSON-933021987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.231s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:07:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-15c8cefa-0217-4d91-957d-96ff256911fb req-cca3cbc9-9db8-42e0-b146-48fecab3b0c3 tempest-AttachVolumeTestJSON-933021987 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db', 'name': 'volume-783c0a8d-6179-4abd-b50d-bbb69259fd2f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cd361b89-c20f-4e02-b37f-35b98be4203f', 'enforce_multipath': True} {{(pid=86837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 13:07:57 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-15c8cefa-0217-4d91-957d-96ff256911fb req-cca3cbc9-9db8-42e0-b146-48fecab3b0c3 tempest-AttachVolumeTestJSON-933021987 None] attachment_update completed successfully.
Jul 03 13:07:58 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-cf153b38-1d29-43d4-a397-d85e246162e6 req-7b6f112d-3a3f-4263-87f6-f6b16727e4e9 tempest-VolumesSnapshotsTestJSON-1909492351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c.a24afcad-869f-4cfc-8bf1-3ee244f5a5b1" returned: 0 in 1.203s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [req-cf153b38-1d29-43d4-a397-d85e246162e6 req-7b6f112d-3a3f-4263-87f6-f6b16727e4e9 tempest-VolumesSnapshotsTestJSON-1909492351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73aa988d-1671-4570-8194-3ef504472b7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:07:58 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead7dfc4-edb1-41c5-aac4-5651551d265a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:07:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-cf153b38-1d29-43d4-a397-d85e246162e6 req-7b6f112d-3a3f-4263-87f6-f6b16727e4e9 tempest-VolumesSnapshotsTestJSON-1909492351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:58 devstack sudo[95380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c
Jul 03 13:07:58 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:59 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:07:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Flow 'volume_create_manager' (6c54d93e-ec04-42db-bea3-ca09b954686a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:07:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d38bd37b-e1a6-4f8b-a7c1-d5a88172aec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d38bd37b-e1a6-4f8b-a7c1-d5a88172aec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1995197090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f688ce-750b-4019-a53c-a652a3cd3b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c382aea4184fa8b5aeeefb40686d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:59Z,use_quota=True,user_id='6dbfc5654b6a48d59c1ccef933f20327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5544b4e3-447d-43bc-8bb5-b3a17d7e88be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5544b4e3-447d-43bc-8bb5-b3a17d7e88be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac31d4df-35e1-4b3c-8e8c-8db757eeea4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:59 devstack cinder-volume[86837]: DEBUG cinder.image.glance [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Creating Keystone auth plugin from conf {{(pid=86837) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 13:07:59 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root
Jul 03 13:07:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-cf153b38-1d29-43d4-a397-d85e246162e6 req-7b6f112d-3a3f-4263-87f6-f6b16727e4e9 tempest-VolumesSnapshotsTestJSON-1909492351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c" returned: 0 in 1.235s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:07:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-cf153b38-1d29-43d4-a397-d85e246162e6 req-7b6f112d-3a3f-4263-87f6-f6b16727e4e9 tempest-VolumesSnapshotsTestJSON-1909492351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c.a24afcad-869f-4cfc-8bf1-3ee244f5a5b1 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:07:59 devstack sudo[95700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c.a24afcad-869f-4cfc-8bf1-3ee244f5a5b1
Jul 03 13:07:59 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:07:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac31d4df-35e1-4b3c-8e8c-8db757eeea4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e1f688ce-750b-4019-a53c-a652a3cd3b98', 'volume_name': 'volume-e1f688ce-750b-4019-a53c-a652a3cd3b98', 'volume_size': 1, 'image_id': '6205b5bb-0e52-4074-98de-35ab3e76638b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6205b5bb-0e52-4074-98de-35ab3e76638b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c125c5701081483fb4d62cc48d112711', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6205b5bb-0e52-4074-98de-35ab3e76638b', 'created_at': datetime.datetime(2026, 7, 3, 10, 50, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 50, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6205b5bb-0e52-4074-98de-35ab3e76638b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7aa53c1487d0>}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bca7eb5-edb7-4027-a0ae-d3c4a6d74d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bca7eb5-edb7-4027-a0ae-d3c4a6d74d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:07:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235f784e-a5a6-47e3-823c-c6f605d6f1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:07:59 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Volume e1f688ce-750b-4019-a53c-a652a3cd3b98: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e1f688ce-750b-4019-a53c-a652a3cd3b98', 'volume_size': 1, 'image_id': '6205b5bb-0e52-4074-98de-35ab3e76638b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6205b5bb-0e52-4074-98de-35ab3e76638b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c125c5701081483fb4d62cc48d112711', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6205b5bb-0e52-4074-98de-35ab3e76638b', 'created_at': datetime.datetime(2026, 7, 3, 10, 50, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 50, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6205b5bb-0e52-4074-98de-35ab3e76638b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7aa53c1487d0>}
Jul 03 13:07:59 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Trying to clone e1f688ce-750b-4019-a53c-a652a3cd3b98 from image 6205b5bb-0e52-4074-98de-35ab3e76638b at location (None, [{'url': 'file:///opt/stack/data/glance/images/6205b5bb-0e52-4074-98de-35ab3e76638b', 'metadata': {}}]). {{(pid=86837) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 03 13:08:00 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_e1g94zd9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86837) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 03 13:08:00 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Image download 20.69 MB at 20.69 MB/s
Jul 03 13:08:00 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb96043-fbb9-43af-b2f4-3f5819e0ae6f]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_e1g94zd9devstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:00 devstack sudo[95728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_e1g94zd9devstack@QuobyteHD
Jul 03 13:08:00 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:00 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-cf153b38-1d29-43d4-a397-d85e246162e6 req-7b6f112d-3a3f-4263-87f6-f6b16727e4e9 tempest-VolumesSnapshotsTestJSON-1909492351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c.a24afcad-869f-4cfc-8bf1-3ee244f5a5b1" returned: 0 in 1.162s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-cf153b38-1d29-43d4-a397-d85e246162e6 req-7b6f112d-3a3f-4263-87f6-f6b16727e4e9 tempest-VolumesSnapshotsTestJSON-1909492351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c.a24afcad-869f-4cfc-8bf1-3ee244f5a5b1 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:00 devstack sudo[95730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c.a24afcad-869f-4cfc-8bf1-3ee244f5a5b1
Jul 03 13:08:00 devstack sudo[95730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:01 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_e1g94zd9devstack@QuobyteHD" returned: 0 in 0.921s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:01 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Temporary image 6205b5bb-0e52-4074-98de-35ab3e76638b is fetched for user 6dbfc5654b6a48d59c1ccef933f20327. {{(pid=86837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 03 13:08:01 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9391437-cde7-4765-a62b-282ae3f48f9e]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_e1g94zd9devstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:01 devstack sudo[95736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_e1g94zd9devstack@QuobyteHD
Jul 03 13:08:01 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:01 devstack sudo[95730]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-cf153b38-1d29-43d4-a397-d85e246162e6 req-7b6f112d-3a3f-4263-87f6-f6b16727e4e9 tempest-VolumesSnapshotsTestJSON-1909492351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c.a24afcad-869f-4cfc-8bf1-3ee244f5a5b1" returned: 0 in 0.970s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:01 devstack cinder-volume[86837]: DEBUG cinder.coordination [req-cf153b38-1d29-43d4-a397-d85e246162e6 req-7b6f112d-3a3f-4263-87f6-f6b16727e4e9 tempest-VolumesSnapshotsTestJSON-1909492351 None] Lock "cinder-quobyte-a24afcad-869f-4cfc-8bf1-3ee244f5a5b1" released by "_delete_snapshot" :: held 4.751s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:08:01 devstack cinder-volume[86837]: DEBUG cinder.coordination [req-cf153b38-1d29-43d4-a397-d85e246162e6 req-7b6f112d-3a3f-4263-87f6-f6b16727e4e9 tempest-VolumesSnapshotsTestJSON-1909492351 None] Lock "cinder-quobyte-73aa988d-1671-4570-8194-3ef504472b7c" released by "delete_snapshot" :: held 4.785s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:08:01 devstack cinder-volume[86837]: DEBUG cinder.quota [req-cf153b38-1d29-43d4-a397-d85e246162e6 req-7b6f112d-3a3f-4263-87f6-f6b16727e4e9 tempest-VolumesSnapshotsTestJSON-1909492351 None] Created reservations ['fb5f9183-710f-4925-81fa-d9574acd746b', 'e7df65e0-0fc8-4492-b651-e3a499ea8f2c', 'f26d7e34-c8f3-4f07-8189-f8ebc545279d', '536ee40b-36a7-4eac-803c-ab974d917059'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:08:02 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-cf153b38-1d29-43d4-a397-d85e246162e6 req-7b6f112d-3a3f-4263-87f6-f6b16727e4e9 tempest-VolumesSnapshotsTestJSON-1909492351 None] Delete snapshot completed successfully.
Jul 03 13:08:02 devstack cinder-volume[86837]: DEBUG cinder.coordination [req-cf153b38-1d29-43d4-a397-d85e246162e6 req-7b6f112d-3a3f-4263-87f6-f6b16727e4e9 tempest-VolumesSnapshotsTestJSON-1909492351 None] Lock "cinder-a24afcad-869f-4cfc-8bf1-3ee244f5a5b1-delete_snapshot" released by "delete_snapshot" :: held 5.007s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:08:02 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_e1g94zd9devstack@QuobyteHD" returned: 0 in 1.054s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1995197090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f688ce-750b-4019-a53c-a652a3cd3b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c382aea4184fa8b5aeeefb40686d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:07:59Z,use_quota=True,user_id='6dbfc5654b6a48d59c1ccef933f20327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:08:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Creating volume e1f688ce-750b-4019-a53c-a652a3cd3b98 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:08:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:08:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:08:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:08:02 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:08:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:02 devstack cinder-volume[86837]: DEBUG cinder.coordination [req-3728fd51-7249-436f-b118-d0362d59ea9b req-cf969717-7009-4e12-9be5-7a5ce64d348f tempest-VolumesSnapshotsTestJSON-1909492351 None] Acquiring lock "cinder-73aa988d-1671-4570-8194-3ef504472b7c-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:08:02 devstack sudo[95743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98 1073741824
Jul 03 13:08:02 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:02 devstack cinder-volume[86837]: DEBUG cinder.coordination [req-3728fd51-7249-436f-b118-d0362d59ea9b req-cf969717-7009-4e12-9be5-7a5ce64d348f tempest-VolumesSnapshotsTestJSON-1909492351 None] Lock "cinder-73aa988d-1671-4570-8194-3ef504472b7c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:08:02 devstack cinder-volume[86837]: DEBUG cinder.coordination [req-3728fd51-7249-436f-b118-d0362d59ea9b req-cf969717-7009-4e12-9be5-7a5ce64d348f tempest-VolumesSnapshotsTestJSON-1909492351 None] Acquiring lock "cinder-quobyte-73aa988d-1671-4570-8194-3ef504472b7c" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:08:02 devstack cinder-volume[86837]: DEBUG cinder.coordination [req-3728fd51-7249-436f-b118-d0362d59ea9b req-cf969717-7009-4e12-9be5-7a5ce64d348f tempest-VolumesSnapshotsTestJSON-1909492351 None] Lock "cinder-quobyte-73aa988d-1671-4570-8194-3ef504472b7c" acquired by "delete_volume" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:08:02 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a2d135-344b-423b-ba06-28d6cb49a78b]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-3728fd51-7249-436f-b118-d0362d59ea9b req-cf969717-7009-4e12-9be5-7a5ce64d348f tempest-VolumesSnapshotsTestJSON-1909492351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:02 devstack sudo[95745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c
Jul 03 13:08:02 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:03 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98 1073741824" returned: 0 in 1.371s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:04 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:04 devstack sudo[95794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98
Jul 03 13:08:04 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-3728fd51-7249-436f-b118-d0362d59ea9b req-cf969717-7009-4e12-9be5-7a5ce64d348f tempest-VolumesSnapshotsTestJSON-1909492351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c" returned: 0 in 1.367s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-3728fd51-7249-436f-b118-d0362d59ea9b req-cf969717-7009-4e12-9be5-7a5ce64d348f tempest-VolumesSnapshotsTestJSON-1909492351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:04 devstack sudo[95796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c
Jul 03 13:08:04 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:05 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-3728fd51-7249-436f-b118-d0362d59ea9b req-cf969717-7009-4e12-9be5-7a5ce64d348f tempest-VolumesSnapshotsTestJSON-1909492351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73aa988d-1671-4570-8194-3ef504472b7c" returned: 0 in 0.828s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:05 devstack cinder-volume[86837]: DEBUG cinder.coordination [req-3728fd51-7249-436f-b118-d0362d59ea9b req-cf969717-7009-4e12-9be5-7a5ce64d348f tempest-VolumesSnapshotsTestJSON-1909492351 None] Lock "cinder-quobyte-73aa988d-1671-4570-8194-3ef504472b7c" released by "delete_volume" :: held 2.275s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:08:05 devstack cinder-volume[86837]: DEBUG cinder.quota [req-3728fd51-7249-436f-b118-d0362d59ea9b req-cf969717-7009-4e12-9be5-7a5ce64d348f tempest-VolumesSnapshotsTestJSON-1909492351 None] Created reservations ['0a32695a-632e-4df6-a164-57dddc6b4df2', 'cb12a88f-ebd6-466a-a722-5f1929aeb45d', '59fe408f-ba3f-475e-b959-0d0f9f62c268', 'b9d1f2ae-ef50-41d2-ae06-f8c7b673a2ca'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:08:05 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98" returned: 0 in 1.066s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:05 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] <== create_volume: return (2557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:08:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.565s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:05 devstack cinder-volume[86837]: DEBUG cinder.volume.volume_utils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Attempting download of 6205b5bb-0e52-4074-98de-35ab3e76638b ((None, [{'url': 'file:///opt/stack/data/glance/images/6205b5bb-0e52-4074-98de-35ab3e76638b', 'metadata': {}}])) to volume e1f688ce-750b-4019-a53c-a652a3cd3b98. {{(pid=86837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 03 13:08:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-3728fd51-7249-436f-b118-d0362d59ea9b req-cf969717-7009-4e12-9be5-7a5ce64d348f tempest-VolumesSnapshotsTestJSON-1909492351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-3728fd51-7249-436f-b118-d0362d59ea9b req-cf969717-7009-4e12-9be5-7a5ce64d348f tempest-VolumesSnapshotsTestJSON-1909492351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:05 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [req-3728fd51-7249-436f-b118-d0362d59ea9b req-cf969717-7009-4e12-9be5-7a5ce64d348f tempest-VolumesSnapshotsTestJSON-1909492351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:08:05 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [req-3728fd51-7249-436f-b118-d0362d59ea9b req-cf969717-7009-4e12-9be5-7a5ce64d348f tempest-VolumesSnapshotsTestJSON-1909492351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:08:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-3728fd51-7249-436f-b118-d0362d59ea9b req-cf969717-7009-4e12-9be5-7a5ce64d348f tempest-VolumesSnapshotsTestJSON-1909492351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-3728fd51-7249-436f-b118-d0362d59ea9b req-cf969717-7009-4e12-9be5-7a5ce64d348f tempest-VolumesSnapshotsTestJSON-1909492351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:05 devstack sudo[95802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:08:05 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:05 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ed6e9d-8fc8-437c-b57b-8f5567f801ed]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6205b5bb-0e52-4074-98de-35ab3e76638b_90mqqqwh {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:05 devstack sudo[95804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6205b5bb-0e52-4074-98de-35ab3e76638b_90mqqqwh
Jul 03 13:08:05 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:06 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-3728fd51-7249-436f-b118-d0362d59ea9b req-cf969717-7009-4e12-9be5-7a5ce64d348f tempest-VolumesSnapshotsTestJSON-1909492351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.834s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:06 devstack cinder-volume[86837]: DEBUG cinder.manager [req-3728fd51-7249-436f-b118-d0362d59ea9b req-cf969717-7009-4e12-9be5-7a5ce64d348f tempest-VolumesSnapshotsTestJSON-1909492351 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:08:06 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-3728fd51-7249-436f-b118-d0362d59ea9b req-cf969717-7009-4e12-9be5-7a5ce64d348f tempest-VolumesSnapshotsTestJSON-1909492351 None] Deleted volume successfully.
Jul 03 13:08:06 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6205b5bb-0e52-4074-98de-35ab3e76638b_90mqqqwh" returned: 0 in 0.812s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6205b5bb-0e52-4074-98de-35ab3e76638b_90mqqqwh {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:06 devstack cinder-volume[86837]: DEBUG cinder.coordination [req-3728fd51-7249-436f-b118-d0362d59ea9b req-cf969717-7009-4e12-9be5-7a5ce64d348f tempest-VolumesSnapshotsTestJSON-1909492351 None] Lock "cinder-73aa988d-1671-4570-8194-3ef504472b7c-delete_volume" released by "delete_volume" :: held 3.482s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:08:06 devstack sudo[95810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6205b5bb-0e52-4074-98de-35ab3e76638b_90mqqqwh
Jul 03 13:08:06 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:07 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6205b5bb-0e52-4074-98de-35ab3e76638b_90mqqqwh" returned: 1 in 1.011s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6205b5bb-0e52-4074-98de-35ab3e76638b_90mqqqwh' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:08:07 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d744a6cb-6440-4b6a-a074-02141ed442f4]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_e1g94zd9devstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:07 devstack sudo[95814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_e1g94zd9devstack@QuobyteHD
Jul 03 13:08:07 devstack sudo[95814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:08 devstack sudo[95814]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_e1g94zd9devstack@QuobyteHD" returned: 0 in 0.922s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:08 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] 6205b5bb-0e52-4074-98de-35ab3e76638b was qcow2, converting to raw {{(pid=86837) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 03 13:08:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_e1g94zd9devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:08 devstack sudo[95820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_e1g94zd9devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98
Jul 03 13:08:08 devstack sudo[95820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:11 devstack sudo[95820]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_e1g94zd9devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98" returned: 0 in 3.399s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:11 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_e1g94zd9devstack@QuobyteHD, size 112.00 MB, duration 3.40 sec, destination /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98 {{(pid=86837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 13:08:11 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Converted 112.00 MB image at 32.91 MB/s
Jul 03 13:08:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:11 devstack sudo[95847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98 1G
Jul 03 13:08:11 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:12 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98 1G" returned: 0 in 1.032s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:12 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1e6ffe-04e8-4eb1-8987-083073ebef38]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:12 devstack sudo[95902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98
Jul 03 13:08:12 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:13 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98" returned: 0 in 0.856s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:13 devstack sudo[95950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98
Jul 03 13:08:13 devstack sudo[95950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:14 devstack sudo[95950]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98" returned: 1 in 0.891s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:08:14 devstack cinder-volume[86837]: DEBUG cinder.volume.volume_utils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Downloaded image 6205b5bb-0e52-4074-98de-35ab3e76638b ((None, [{'url': 'file:///opt/stack/data/glance/images/6205b5bb-0e52-4074-98de-35ab3e76638b', 'metadata': {}}])) to volume e1f688ce-750b-4019-a53c-a652a3cd3b98 successfully. {{(pid=86837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 03 13:08:14 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Temporary image 6205b5bb-0e52-4074-98de-35ab3e76638b for user 6dbfc5654b6a48d59c1ccef933f20327 is deleted. {{(pid=86837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 03 13:08:14 devstack cinder-volume[86837]: DEBUG cinder.volume.volume_utils [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Marking volume e1f688ce-750b-4019-a53c-a652a3cd3b98 as bootable. {{(pid=86837) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 03 13:08:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:08:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:08:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:08:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:14 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Copying metadata from image 6205b5bb-0e52-4074-98de-35ab3e76638b to e1f688ce-750b-4019-a53c-a652a3cd3b98. {{(pid=86837) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 13:08:14 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Creating volume glance metadata for volume e1f688ce-750b-4019-a53c-a652a3cd3b98 backed by image 6205b5bb-0e52-4074-98de-35ab3e76638b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6205b5bb-0e52-4074-98de-35ab3e76638b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86837) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 13:08:14 devstack sudo[95956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:08:14 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:15 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.822s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:15 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:08:15 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:08:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 28 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:08:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>, <Thread(tpool_thread_0, started daemon 134850092431040)>, <Thread(tpool_thread_1, started daemon 134850084021952)>, <Thread(tpool_thread_2, started daemon 134850075612864)>, <Thread(tpool_thread_3, started daemon 134850067203776)>, <Thread(tpool_thread_4, started daemon 134850058794688)>, <Thread(tpool_thread_5, started daemon 134850050385600)>, <Thread(tpool_thread_6, started daemon 134850041976512)>, <Thread(tpool_thread_7, started daemon 134850033567424)>, <Thread(tpool_thread_8, started daemon 134850025158336)>, <Thread(tpool_thread_9, started daemon 134850016749248)>, <Thread(tpool_thread_10, started daemon 134850008340160)>, <Thread(tpool_thread_11, started daemon 134849999931072)>, <Thread(tpool_thread_12, started daemon 134849991521984)>, <Thread(tpool_thread_13, started daemon 134849983112896)>, <Thread(tpool_thread_14, started daemon 134849974703808)>, <Thread(tpool_thread_15, started daemon 134849966294720)>, <Thread(tpool_thread_16, started daemon 134849957885632)>, <Thread(tpool_thread_17, started daemon 134849949476544)>, <Thread(tpool_thread_18, started daemon 134849941067456)>, <Thread(tpool_thread_19, started daemon 134849932658368)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:08:16 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235f784e-a5a6-47e3-823c-c6f605d6f1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1f688ce-750b-4019-a53c-a652a3cd3b98', 'volume_size': 1, 'image_id': '6205b5bb-0e52-4074-98de-35ab3e76638b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6205b5bb-0e52-4074-98de-35ab3e76638b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c125c5701081483fb4d62cc48d112711', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6205b5bb-0e52-4074-98de-35ab3e76638b', 'created_at': datetime.datetime(2026, 7, 3, 10, 50, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 50, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6205b5bb-0e52-4074-98de-35ab3e76638b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7aa53c1487d0>}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:16 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21841bc4-b0d9-45e4-83c8-cab2f1ecd784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:16 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Volume volume-e1f688ce-750b-4019-a53c-a652a3cd3b98 (e1f688ce-750b-4019-a53c-a652a3cd3b98): created successfully
Jul 03 13:08:16 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21841bc4-b0d9-45e4-83c8-cab2f1ecd784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:16 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Flow 'volume_create_manager' (6c54d93e-ec04-42db-bea3-ca09b954686a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:08:16 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-2522b1a8-c07e-4c06-a44a-085f2b8c924f tempest-VolumesImageMetadata-2012329168 None] Created volume successfully.
Jul 03 13:08:17 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-b7b40500-5ff9-402b-b959-0f6467a34d33 tempest-GroupSnapshotsTest-926850929 None] Group tempest-GroupSnapshotsTest-Group-913136839: creating
Jul 03 13:08:17 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-b7b40500-5ff9-402b-b959-0f6467a34d33 tempest-GroupSnapshotsTest-926850929 None] Group tempest-GroupSnapshotsTest-Group-913136839: created successfully
Jul 03 13:08:17 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-b7b40500-5ff9-402b-b959-0f6467a34d33 tempest-GroupSnapshotsTest-926850929 None] Create group completed successfully.
Jul 03 13:08:18 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6f98c76c-9c58-4a57-a2e1-8eca948a6be6 tempest-VolumesImageMetadata-2012329168 None] Acquiring lock "cinder-e1f688ce-750b-4019-a53c-a652a3cd3b98-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:08:18 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6f98c76c-9c58-4a57-a2e1-8eca948a6be6 tempest-VolumesImageMetadata-2012329168 None] Lock "cinder-e1f688ce-750b-4019-a53c-a652a3cd3b98-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:08:18 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6f98c76c-9c58-4a57-a2e1-8eca948a6be6 tempest-VolumesImageMetadata-2012329168 None] Acquiring lock "cinder-quobyte-e1f688ce-750b-4019-a53c-a652a3cd3b98" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:08:18 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6f98c76c-9c58-4a57-a2e1-8eca948a6be6 tempest-VolumesImageMetadata-2012329168 None] Lock "cinder-quobyte-e1f688ce-750b-4019-a53c-a652a3cd3b98" acquired by "delete_volume" :: waited 0.038s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:08:18 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf448d17-c885-4c66-9379-3cf77d6a9059]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6f98c76c-9c58-4a57-a2e1-8eca948a6be6 tempest-VolumesImageMetadata-2012329168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:19 devstack sudo[96407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98
Jul 03 13:08:19 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:20 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:08:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Flow 'volume_create_manager' (60a9d47c-5bbf-4284-a625-1ac9dd9b9e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:08:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c969633-1668-45fc-9e52-1bcaa5189cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c969633-1668-45fc-9e52-1bcaa5189cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1025161049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9c873d03-9d91-4d3e-b3a6-5a681a86721b,host='devstack@QuobyteHD#QuobyteHD',id=b262739a-e9df-4031-a8c1-3a82936e62ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='619bde85acf74a0dbf92c75c3920ce29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:08:20Z,use_quota=True,user_id='01db4f9516244a859e4161f1c41ba96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1085c7d8-8a24-4ea6-91fd-edf8600f1602),volume_type_id=1085c7d8-8a24-4ea6-91fd-edf8600f1602)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5082fc08-d4a5-4632-9557-8133342711bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5082fc08-d4a5-4632-9557-8133342711bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c5bbaa-0588-4851-8eb3-fb886e682776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c5bbaa-0588-4851-8eb3-fb886e682776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b262739a-e9df-4031-a8c1-3a82936e62ca', 'volume_name': 'volume-b262739a-e9df-4031-a8c1-3a82936e62ca', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887720ea-c63f-4f22-b703-6bb1b86c9bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887720ea-c63f-4f22-b703-6bb1b86c9bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22cc2b0b-13d7-4187-86d1-1ee03fa8126e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:20 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Volume b262739a-e9df-4031-a8c1-3a82936e62ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b262739a-e9df-4031-a8c1-3a82936e62ca', 'volume_size': 1}
Jul 03 13:08:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:20 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9c873d03-9d91-4d3e-b3a6-5a681a86721b,created_at=2026-07-03T11:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1025161049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9c873d03-9d91-4d3e-b3a6-5a681a86721b,host='devstack@QuobyteHD#QuobyteHD',id=b262739a-e9df-4031-a8c1-3a82936e62ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='619bde85acf74a0dbf92c75c3920ce29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:08:20Z,use_quota=True,user_id='01db4f9516244a859e4161f1c41ba96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1085c7d8-8a24-4ea6-91fd-edf8600f1602),volume_type_id=1085c7d8-8a24-4ea6-91fd-edf8600f1602)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:08:20 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Creating volume b262739a-e9df-4031-a8c1-3a82936e62ca {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:08:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:20 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:08:20 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:08:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:20 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:08:20 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:08:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:20 devstack sudo[96465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca 1073741824
Jul 03 13:08:20 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:20 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6f98c76c-9c58-4a57-a2e1-8eca948a6be6 tempest-VolumesImageMetadata-2012329168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98" returned: 0 in 2.202s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6f98c76c-9c58-4a57-a2e1-8eca948a6be6 tempest-VolumesImageMetadata-2012329168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:21 devstack sudo[96470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98
Jul 03 13:08:21 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:23 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6f98c76c-9c58-4a57-a2e1-8eca948a6be6 tempest-VolumesImageMetadata-2012329168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98" returned: 1 in 2.073s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6f98c76c-9c58-4a57-a2e1-8eca948a6be6 tempest-VolumesImageMetadata-2012329168 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:08:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6f98c76c-9c58-4a57-a2e1-8eca948a6be6 tempest-VolumesImageMetadata-2012329168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:23 devstack sudo[96496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98
Jul 03 13:08:23 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:23 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca 1073741824" returned: 0 in 2.682s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:23 devstack sudo[96498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca
Jul 03 13:08:23 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:24 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6f98c76c-9c58-4a57-a2e1-8eca948a6be6 tempest-VolumesImageMetadata-2012329168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1f688ce-750b-4019-a53c-a652a3cd3b98" returned: 0 in 1.065s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6f98c76c-9c58-4a57-a2e1-8eca948a6be6 tempest-VolumesImageMetadata-2012329168 None] Lock "cinder-quobyte-e1f688ce-750b-4019-a53c-a652a3cd3b98" released by "delete_volume" :: held 5.525s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:08:24 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-6f98c76c-9c58-4a57-a2e1-8eca948a6be6 tempest-VolumesImageMetadata-2012329168 None] Created reservations ['31677f60-0f48-4794-af87-6341fef0b634', 'f269c390-678a-4050-9b4a-6e9bc91bf724', '12ea2cb7-87fd-488e-8d24-a0ef6448b0db', 'ac40b444-94f1-43b9-8a55-4ba2c1a61bd6'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:08:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6f98c76c-9c58-4a57-a2e1-8eca948a6be6 tempest-VolumesImageMetadata-2012329168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6f98c76c-9c58-4a57-a2e1-8eca948a6be6 tempest-VolumesImageMetadata-2012329168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6f98c76c-9c58-4a57-a2e1-8eca948a6be6 tempest-VolumesImageMetadata-2012329168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:08:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6f98c76c-9c58-4a57-a2e1-8eca948a6be6 tempest-VolumesImageMetadata-2012329168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:08:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6f98c76c-9c58-4a57-a2e1-8eca948a6be6 tempest-VolumesImageMetadata-2012329168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6f98c76c-9c58-4a57-a2e1-8eca948a6be6 tempest-VolumesImageMetadata-2012329168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:24 devstack sudo[96501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:08:24 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:24 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca" returned: 0 in 1.346s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] <== create_volume: return (4123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:08:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.128s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22cc2b0b-13d7-4187-86d1-1ee03fa8126e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b262739a-e9df-4031-a8c1-3a82936e62ca', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (433a6d02-a4be-4a0b-be46-db59d75c8b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:24 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Volume volume-b262739a-e9df-4031-a8c1-3a82936e62ca (b262739a-e9df-4031-a8c1-3a82936e62ca): created successfully
Jul 03 13:08:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (433a6d02-a4be-4a0b-be46-db59d75c8b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Flow 'volume_create_manager' (60a9d47c-5bbf-4284-a625-1ac9dd9b9e02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:08:25 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-37d65a1d-4f21-4e2e-9db6-3fcae81aa445 tempest-GroupSnapshotsTest-926850929 None] Created volume successfully.
Jul 03 13:08:25 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6f98c76c-9c58-4a57-a2e1-8eca948a6be6 tempest-VolumesImageMetadata-2012329168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.238s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:25 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-6f98c76c-9c58-4a57-a2e1-8eca948a6be6 tempest-VolumesImageMetadata-2012329168 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:08:25 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-6f98c76c-9c58-4a57-a2e1-8eca948a6be6 tempest-VolumesImageMetadata-2012329168 None] Deleted volume successfully.
Jul 03 13:08:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6f98c76c-9c58-4a57-a2e1-8eca948a6be6 tempest-VolumesImageMetadata-2012329168 None] Lock "cinder-e1f688ce-750b-4019-a53c-a652a3cd3b98-delete_volume" released by "delete_volume" :: held 7.428s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:08:26 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-880de5dd-b635-4643-84aa-4fe16225b32b tempest-GroupSnapshotsTest-926850929 None] GroupSnapshot 62336c1a-5cab-4008-a0ab-b5cead666de9: creating.
Jul 03 13:08:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-880de5dd-b635-4643-84aa-4fe16225b32b tempest-GroupSnapshotsTest-926850929 None] Group snapshot 62336c1a-5cab-4008-a0ab-b5cead666de9: creating. {{(pid=86837) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 03 13:08:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-880de5dd-b635-4643-84aa-4fe16225b32b tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-880de5dd-b635-4643-84aa-4fe16225b32b tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-880de5dd-b635-4643-84aa-4fe16225b32b tempest-GroupSnapshotsTest-926850929 None] Creating offline snapshot ebd72356-3614-471c-b3e9-3f446fdd9d03 of volume b262739a-e9df-4031-a8c1-3a82936e62ca {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:08:26 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a28f415-9eca-4665-8081-e024e77b7676]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-880de5dd-b635-4643-84aa-4fe16225b32b tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:26 devstack sudo[96505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca
Jul 03 13:08:26 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:28 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-880de5dd-b635-4643-84aa-4fe16225b32b tempest-GroupSnapshotsTest-926850929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca" returned: 0 in 1.981s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-880de5dd-b635-4643-84aa-4fe16225b32b tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.ebd72356-3614-471c-b3e9-3f446fdd9d03 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:28 devstack sudo[96512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.ebd72356-3614-471c-b3e9-3f446fdd9d03 1G
Jul 03 13:08:28 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:29 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-880de5dd-b635-4643-84aa-4fe16225b32b tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.ebd72356-3614-471c-b3e9-3f446fdd9d03 1G" returned: 0 in 1.636s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-880de5dd-b635-4643-84aa-4fe16225b32b tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b262739a-e9df-4031-a8c1-3a82936e62ca -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.ebd72356-3614-471c-b3e9-3f446fdd9d03 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:29 devstack sudo[96518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b262739a-e9df-4031-a8c1-3a82936e62ca -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.ebd72356-3614-471c-b3e9-3f446fdd9d03
Jul 03 13:08:29 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:31 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-880de5dd-b635-4643-84aa-4fe16225b32b tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b262739a-e9df-4031-a8c1-3a82936e62ca -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.ebd72356-3614-471c-b3e9-3f446fdd9d03" returned: 0 in 1.336s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:31 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-880de5dd-b635-4643-84aa-4fe16225b32b tempest-GroupSnapshotsTest-926850929 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.ebd72356-3614-471c-b3e9-3f446fdd9d03 is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 13:08:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-880de5dd-b635-4643-84aa-4fe16225b32b tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.ebd72356-3614-471c-b3e9-3f446fdd9d03 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:31 devstack sudo[96523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.ebd72356-3614-471c-b3e9-3f446fdd9d03
Jul 03 13:08:31 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:31 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-880de5dd-b635-4643-84aa-4fe16225b32b tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.ebd72356-3614-471c-b3e9-3f446fdd9d03" returned: 0 in 0.836s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-880de5dd-b635-4643-84aa-4fe16225b32b tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:32 devstack sudo[96526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.info
Jul 03 13:08:32 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:32 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:08:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Flow 'volume_create_manager' (d1ee1d29-e19c-4af7-a0a8-4199bf134ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:08:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d95da8-ab72-42fa-bb21-bbe58064f3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d95da8-ab72-42fa-bb21-bbe58064f3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1030045826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1355777b-bfb3-4d84-a8aa-d36063b78e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d107f18b9194cc7b68335c6762dd2bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:08:32Z,use_quota=True,user_id='1f52404ad05e4b7fbffec77f7c864024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21a00b9-08c7-48c4-a27b-546ce7d00310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21a00b9-08c7-48c4-a27b-546ce7d00310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (122f7272-24eb-4e22-817b-0a3fe654e500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (122f7272-24eb-4e22-817b-0a3fe654e500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1355777b-bfb3-4d84-a8aa-d36063b78e54', 'volume_name': 'volume-1355777b-bfb3-4d84-a8aa-d36063b78e54', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8452f8e-9f45-40b6-8a0e-74864966cdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8452f8e-9f45-40b6-8a0e-74864966cdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4724feee-ed48-4fff-a254-847f1b06feaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:32 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Volume 1355777b-bfb3-4d84-a8aa-d36063b78e54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1355777b-bfb3-4d84-a8aa-d36063b78e54', 'volume_size': 1}
Jul 03 13:08:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:32 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-880de5dd-b635-4643-84aa-4fe16225b32b tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.info" returned: 0 in 0.814s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:32 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-880de5dd-b635-4643-84aa-4fe16225b32b tempest-GroupSnapshotsTest-926850929 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 13:08:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-880de5dd-b635-4643-84aa-4fe16225b32b tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:32 devstack sudo[96554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.info
Jul 03 13:08:32 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:33 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-880de5dd-b635-4643-84aa-4fe16225b32b tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.info" returned: 0 in 0.760s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-880de5dd-b635-4643-84aa-4fe16225b32b tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.482s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.271s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:33 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1030045826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1355777b-bfb3-4d84-a8aa-d36063b78e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d107f18b9194cc7b68335c6762dd2bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:08:32Z,use_quota=True,user_id='1f52404ad05e4b7fbffec77f7c864024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:08:33 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Creating volume 1355777b-bfb3-4d84-a8aa-d36063b78e54 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:08:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:33 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:08:33 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:08:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:33 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:08:33 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:08:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:33 devstack sudo[96557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54 1073741824
Jul 03 13:08:33 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:33 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-880de5dd-b635-4643-84aa-4fe16225b32b tempest-GroupSnapshotsTest-926850929 None] group_snapshot 62336c1a-5cab-4008-a0ab-b5cead666de9: created successfully
Jul 03 13:08:34 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54 1073741824" returned: 0 in 1.126s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:34 devstack sudo[96562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54
Jul 03 13:08:34 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:35 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54" returned: 0 in 1.005s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] <== create_volume: return (2188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:08:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.193s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.599s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:35 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "cinder-quobyte-ebd72356-3614-471c-b3e9-3f446fdd9d03-ed128367-7a50-4e05-b3e0-5f17d7457bd6" by "_create_volume_from_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:08:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4724feee-ed48-4fff-a254-847f1b06feaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1355777b-bfb3-4d84-a8aa-d36063b78e54', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2792d4b-2b2f-4ed8-b3dc-156a54d83b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:35 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-ebd72356-3614-471c-b3e9-3f446fdd9d03-ed128367-7a50-4e05-b3e0-5f17d7457bd6" acquired by "_create_volume_from_snapshot" :: waited 0.054s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:08:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Creating volume ed128367-7a50-4e05-b3e0-5f17d7457bd6 from snapshot ebd72356-3614-471c-b3e9-3f446fdd9d03 {{(pid=86837) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 13:08:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:08:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:08:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:08:35 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "cinder-quobyte-ed128367-7a50-4e05-b3e0-5f17d7457bd6" by "_copy_volume_from_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:08:35 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Volume volume-1355777b-bfb3-4d84-a8aa-d36063b78e54 (1355777b-bfb3-4d84-a8aa-d36063b78e54): created successfully
Jul 03 13:08:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2792d4b-2b2f-4ed8-b3dc-156a54d83b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Flow 'volume_create_manager' (d1ee1d29-e19c-4af7-a0a8-4199bf134ddc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:08:35 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-ed128367-7a50-4e05-b3e0-5f17d7457bd6" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:08:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] snapshot: ebd72356-3614-471c-b3e9-3f446fdd9d03, volume: ed128367-7a50-4e05-b3e0-5f17d7457bd6,  {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 13:08:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:08:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:08:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:35 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-8828bb1e-b9ed-4e5b-b5fd-c5c6e9a223d8 tempest-VolumesDeleteCascade-510417396 None] Created volume successfully.
Jul 03 13:08:35 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[089e686b-c0e3-45e8-a3c0-87982492984b]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.ebd72356-3614-471c-b3e9-3f446fdd9d03 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:36 devstack sudo[96586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.ebd72356-3614-471c-b3e9-3f446fdd9d03
Jul 03 13:08:36 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3d52d5b4-3f02-4f48-af97-fc05016eaacb tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:37 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.ebd72356-3614-471c-b3e9-3f446fdd9d03" returned: 0 in 1.224s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b262739a-e9df-4031-a8c1-3a82936e62ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:08:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 13:08:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Creating direct copy from snapshot {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 13:08:37 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[87039e29-e0a3-4804-bf08-14b860851644]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:37 devstack sudo[96592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca
Jul 03 13:08:37 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:38 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca" returned: 0 in 0.948s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:38 devstack cinder-volume[86837]: DEBUG cinder.utils [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Path /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ed128367-7a50-4e05-b3e0-5f17d7457bd6 not found in is_blk_device check {{(pid=86837) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 13:08:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ed128367-7a50-4e05-b3e0-5f17d7457bd6 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:38 devstack sudo[96613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ed128367-7a50-4e05-b3e0-5f17d7457bd6
Jul 03 13:08:38 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:43 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ed128367-7a50-4e05-b3e0-5f17d7457bd6" returned: 0 in 5.276s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:43 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b29488-8250-43dc-b762-a423abc586a0]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:43 devstack sudo[96627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca
Jul 03 13:08:43 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:44 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca" returned: 0 in 1.009s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:44 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca, size 1024.00 MB, duration 5.28 sec, destination /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ed128367-7a50-4e05-b3e0-5f17d7457bd6 {{(pid=86837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 13:08:44 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Converted 1024.00 MB image at 194.05 MB/s
Jul 03 13:08:44 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ed128367-7a50-4e05-b3e0-5f17d7457bd6 is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 13:08:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ed128367-7a50-4e05-b3e0-5f17d7457bd6 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:44 devstack sudo[96632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ed128367-7a50-4e05-b3e0-5f17d7457bd6
Jul 03 13:08:44 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:45 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ed128367-7a50-4e05-b3e0-5f17d7457bd6" returned: 0 in 0.743s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-ed128367-7a50-4e05-b3e0-5f17d7457bd6" released by "_copy_volume_from_snapshot" :: held 9.363s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:08:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-ebd72356-3614-471c-b3e9-3f446fdd9d03-ed128367-7a50-4e05-b3e0-5f17d7457bd6" released by "_create_volume_from_snapshot" :: held 9.440s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:08:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.496s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3d52d5b4-3f02-4f48-af97-fc05016eaacb tempest-VolumesDeleteCascade-510417396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.354s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:45 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-3d52d5b4-3f02-4f48-af97-fc05016eaacb tempest-VolumesDeleteCascade-510417396 None] Creating offline snapshot 91858036-2578-4b0d-8a42-661c0bf8c790 of volume 1355777b-bfb3-4d84-a8aa-d36063b78e54 {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:08:45 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:UPDATE=42,cinder:SELECT=43,cinder:DELETE=4,cinder:INSERT=17 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:08:45 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3157f63-b52c-4519-960f-468674e8be59]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3d52d5b4-3f02-4f48-af97-fc05016eaacb tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:45 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-c0002e70-ec23-40be-a181-e4bd2f296132 tempest-GroupSnapshotsTest-926850929 None] Create group from source-snapshot-62336c1a-5cab-4008-a0ab-b5cead666de9 completed successfully.
Jul 03 13:08:45 devstack sudo[96637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54
Jul 03 13:08:45 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:46 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3d52d5b4-3f02-4f48-af97-fc05016eaacb tempest-VolumesDeleteCascade-510417396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54" returned: 0 in 0.938s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3d52d5b4-3f02-4f48-af97-fc05016eaacb tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:46 devstack sudo[96643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790 1G
Jul 03 13:08:46 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:46 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=62,cinder:UPDATE=49,cinder:INSERT=14,cinder:DELETE=3 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:08:46 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7829396f-6266-434c-8487-35b9dcd700c5 tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "cinder-quobyte-ed128367-7a50-4e05-b3e0-5f17d7457bd6" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:08:46 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7829396f-6266-434c-8487-35b9dcd700c5 tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-ed128367-7a50-4e05-b3e0-5f17d7457bd6" acquired by "delete_volume" :: waited 0.029s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:08:46 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63be1d5-9172-4e72-8080-48533d42b635]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7829396f-6266-434c-8487-35b9dcd700c5 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ed128367-7a50-4e05-b3e0-5f17d7457bd6 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:46 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-87594478-598b-4ce2-b948-42c27c1367f5 req-c3b3eb73-95f5-406f-8ec0-ed105b3c6ee8 tempest-AttachVolumeTestJSON-933021987 None] Terminate volume connection completed successfully.
Jul 03 13:08:46 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-87594478-598b-4ce2-b948-42c27c1367f5 req-c3b3eb73-95f5-406f-8ec0-ed105b3c6ee8 tempest-AttachVolumeTestJSON-933021987 None] Deleting attachment cd361b89-c20f-4e02-b37f-35b98be4203f. {{(pid=86837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:08:46 devstack sudo[96646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ed128367-7a50-4e05-b3e0-5f17d7457bd6
Jul 03 13:08:46 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:47 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3d52d5b4-3f02-4f48-af97-fc05016eaacb tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790 1G" returned: 0 in 0.910s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3d52d5b4-3f02-4f48-af97-fc05016eaacb tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1355777b-bfb3-4d84-a8aa-d36063b78e54 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:47 devstack sudo[96653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1355777b-bfb3-4d84-a8aa-d36063b78e54 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790
Jul 03 13:08:47 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:47 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7829396f-6266-434c-8487-35b9dcd700c5 tempest-GroupSnapshotsTest-926850929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ed128367-7a50-4e05-b3e0-5f17d7457bd6" returned: 0 in 0.913s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7829396f-6266-434c-8487-35b9dcd700c5 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ed128367-7a50-4e05-b3e0-5f17d7457bd6 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:47 devstack sudo[96660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ed128367-7a50-4e05-b3e0-5f17d7457bd6
Jul 03 13:08:47 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:48 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3d52d5b4-3f02-4f48-af97-fc05016eaacb tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1355777b-bfb3-4d84-a8aa-d36063b78e54 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790" returned: 0 in 0.930s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:48 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-3d52d5b4-3f02-4f48-af97-fc05016eaacb tempest-VolumesDeleteCascade-510417396 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790 is being set with open permissions: ugo+rw
Jul 03 13:08:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3d52d5b4-3f02-4f48-af97-fc05016eaacb tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:48 devstack sudo[96666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790
Jul 03 13:08:48 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:48 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7829396f-6266-434c-8487-35b9dcd700c5 tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ed128367-7a50-4e05-b3e0-5f17d7457bd6" returned: 0 in 0.910s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:48 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7829396f-6266-434c-8487-35b9dcd700c5 tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-ed128367-7a50-4e05-b3e0-5f17d7457bd6" released by "delete_volume" :: held 1.878s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:08:48 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-7829396f-6266-434c-8487-35b9dcd700c5 tempest-GroupSnapshotsTest-926850929 None] Created reservations ['281f9553-1622-4b0f-b6d5-51c2144f750c'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:08:48 devstack cinder-volume[86837]: WARNING cinder.quota [None req-7829396f-6266-434c-8487-35b9dcd700c5 tempest-GroupSnapshotsTest-926850929 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-291527080 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-291527080, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:08:48 devstack cinder-volume[86837]: WARNING cinder.quota [None req-7829396f-6266-434c-8487-35b9dcd700c5 tempest-GroupSnapshotsTest-926850929 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-291527080 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-291527080, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:08:48 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-7829396f-6266-434c-8487-35b9dcd700c5 tempest-GroupSnapshotsTest-926850929 None] Created reservations ['012963d3-9a1c-41c2-a82a-a872559215eb', '76ea65de-5013-4891-b8e7-5fcb35f54944', 'd1455b86-513a-4a30-8cb4-781051d77b68', '8b1e9f28-85d6-4be4-ba52-015ea00eaaa5'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:08:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-7829396f-6266-434c-8487-35b9dcd700c5 tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-7829396f-6266-434c-8487-35b9dcd700c5 tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:48 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-7829396f-6266-434c-8487-35b9dcd700c5 tempest-GroupSnapshotsTest-926850929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:08:48 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-7829396f-6266-434c-8487-35b9dcd700c5 tempest-GroupSnapshotsTest-926850929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:08:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-7829396f-6266-434c-8487-35b9dcd700c5 tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7829396f-6266-434c-8487-35b9dcd700c5 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:48 devstack sudo[96670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:08:48 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:48 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3d52d5b4-3f02-4f48-af97-fc05016eaacb tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790" returned: 0 in 0.815s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3d52d5b4-3f02-4f48-af97-fc05016eaacb tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:49 devstack sudo[96672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.info
Jul 03 13:08:49 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:49 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:08:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Flow 'volume_create_manager' (45bcd5d9-9bc7-436b-9e18-2b1eb3833382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:08:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f812342d-b394-44fc-922d-7522c31c4e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f812342d-b394-44fc-922d-7522c31c4e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1753855635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65aa8b4-494f-42b2-a371-c5413a2f7442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1a31e80dc74e3e94f52c6857313470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:08:49Z,use_quota=True,user_id='c2c5959311b4407fb9731396d7aedd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16428835-8a03-4e5f-9fa8-104ad91856de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16428835-8a03-4e5f-9fa8-104ad91856de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaeb6c57-4402-4ce3-8fde-1a4af3dfaa14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaeb6c57-4402-4ce3-8fde-1a4af3dfaa14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b65aa8b4-494f-42b2-a371-c5413a2f7442', 'volume_name': 'volume-b65aa8b4-494f-42b2-a371-c5413a2f7442', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ed7edd-0a95-41d8-bdca-02c704854118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ed7edd-0a95-41d8-bdca-02c704854118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43672a17-6773-459e-b816-62255dd5cc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:49 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Volume b65aa8b4-494f-42b2-a371-c5413a2f7442: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b65aa8b4-494f-42b2-a371-c5413a2f7442', 'volume_size': 1}
Jul 03 13:08:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:49 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-2a29ce92-d411-4c2f-8f9f-e390460ef6d9 tempest-GroupSnapshotsTest-926850929 None] group_snapshot 62336c1a-5cab-4008-a0ab-b5cead666de9: deleting
Jul 03 13:08:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2a29ce92-d411-4c2f-8f9f-e390460ef6d9 tempest-GroupSnapshotsTest-926850929 None] group_snapshot 62336c1a-5cab-4008-a0ab-b5cead666de9: deleting {{(pid=86837) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 03 13:08:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2a29ce92-d411-4c2f-8f9f-e390460ef6d9 tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "cinder-quobyte-b262739a-e9df-4031-a8c1-3a82936e62ca" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:08:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2a29ce92-d411-4c2f-8f9f-e390460ef6d9 tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-b262739a-e9df-4031-a8c1-3a82936e62ca" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:08:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2a29ce92-d411-4c2f-8f9f-e390460ef6d9 tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "cinder-quobyte-ebd72356-3614-471c-b3e9-3f446fdd9d03" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:08:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2a29ce92-d411-4c2f-8f9f-e390460ef6d9 tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-ebd72356-3614-471c-b3e9-3f446fdd9d03" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:08:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-2a29ce92-d411-4c2f-8f9f-e390460ef6d9 tempest-GroupSnapshotsTest-926850929 None] Deleting offline snapshot ebd72356-3614-471c-b3e9-3f446fdd9d03 of volume b262739a-e9df-4031-a8c1-3a82936e62ca {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:08:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-2a29ce92-d411-4c2f-8f9f-e390460ef6d9 tempest-GroupSnapshotsTest-926850929 None] snapshot_file for this snap is: volume-b262739a-e9df-4031-a8c1-3a82936e62ca.ebd72356-3614-471c-b3e9-3f446fdd9d03 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:08:49 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac9a677-4b92-4895-8bd6-116186372cd5]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2a29ce92-d411-4c2f-8f9f-e390460ef6d9 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.ebd72356-3614-471c-b3e9-3f446fdd9d03 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:49 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7829396f-6266-434c-8487-35b9dcd700c5 tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.983s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:49 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-7829396f-6266-434c-8487-35b9dcd700c5 tempest-GroupSnapshotsTest-926850929 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:08:49 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-7829396f-6266-434c-8487-35b9dcd700c5 tempest-GroupSnapshotsTest-926850929 None] Delete group completed successfully.
Jul 03 13:08:49 devstack sudo[96680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.ebd72356-3614-471c-b3e9-3f446fdd9d03
Jul 03 13:08:49 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:50 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3d52d5b4-3f02-4f48-af97-fc05016eaacb tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.info" returned: 0 in 1.170s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:50 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-3d52d5b4-3f02-4f48-af97-fc05016eaacb tempest-VolumesDeleteCascade-510417396 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.info is being set with open permissions: ugo+rw
Jul 03 13:08:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3d52d5b4-3f02-4f48-af97-fc05016eaacb tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:50 devstack sudo[96713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.info
Jul 03 13:08:50 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:50 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2a29ce92-d411-4c2f-8f9f-e390460ef6d9 tempest-GroupSnapshotsTest-926850929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.ebd72356-3614-471c-b3e9-3f446fdd9d03" returned: 0 in 1.162s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:50 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-2a29ce92-d411-4c2f-8f9f-e390460ef6d9 tempest-GroupSnapshotsTest-926850929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b262739a-e9df-4031-a8c1-3a82936e62ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:08:50 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48ef550-c42d-4d9b-bf4a-5527e1acec0a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2a29ce92-d411-4c2f-8f9f-e390460ef6d9 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:50 devstack sudo[96719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca
Jul 03 13:08:50 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:50 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3d52d5b4-3f02-4f48-af97-fc05016eaacb tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.info" returned: 0 in 0.745s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3d52d5b4-3f02-4f48-af97-fc05016eaacb tempest-VolumesDeleteCascade-510417396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.677s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.621s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:50 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1753855635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65aa8b4-494f-42b2-a371-c5413a2f7442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1a31e80dc74e3e94f52c6857313470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:08:49Z,use_quota=True,user_id='c2c5959311b4407fb9731396d7aedd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:08:50 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Creating volume b65aa8b4-494f-42b2-a371-c5413a2f7442 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:08:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:50 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:08:50 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:08:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:50 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:08:50 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:08:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b65aa8b4-494f-42b2-a371-c5413a2f7442 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:51 devstack sudo[96722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b65aa8b4-494f-42b2-a371-c5413a2f7442 1073741824
Jul 03 13:08:51 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:51 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-3d52d5b4-3f02-4f48-af97-fc05016eaacb tempest-VolumesDeleteCascade-510417396 None] Create snapshot completed successfully
Jul 03 13:08:51 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2a29ce92-d411-4c2f-8f9f-e390460ef6d9 tempest-GroupSnapshotsTest-926850929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca" returned: 0 in 0.899s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2a29ce92-d411-4c2f-8f9f-e390460ef6d9 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.ebd72356-3614-471c-b3e9-3f446fdd9d03 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:51 devstack sudo[96730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.ebd72356-3614-471c-b3e9-3f446fdd9d03
Jul 03 13:08:51 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ad3cf594-bb0f-4f4a-82e5-81fccbf148e9 tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:52 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b65aa8b4-494f-42b2-a371-c5413a2f7442 1073741824" returned: 0 in 1.034s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b65aa8b4-494f-42b2-a371-c5413a2f7442 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:52 devstack sudo[96734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b65aa8b4-494f-42b2-a371-c5413a2f7442
Jul 03 13:08:52 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:52 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2a29ce92-d411-4c2f-8f9f-e390460ef6d9 tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.ebd72356-3614-471c-b3e9-3f446fdd9d03" returned: 0 in 0.852s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2a29ce92-d411-4c2f-8f9f-e390460ef6d9 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.ebd72356-3614-471c-b3e9-3f446fdd9d03 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:52 devstack sudo[96740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.ebd72356-3614-471c-b3e9-3f446fdd9d03
Jul 03 13:08:52 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:52 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b65aa8b4-494f-42b2-a371-c5413a2f7442" returned: 0 in 0.738s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:08:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ad3cf594-bb0f-4f4a-82e5-81fccbf148e9 tempest-VolumesDeleteCascade-510417396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.821s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43672a17-6773-459e-b816-62255dd5cc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b65aa8b4-494f-42b2-a371-c5413a2f7442', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829de806-7177-4b9f-96db-a0e5a4091e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-ad3cf594-bb0f-4f4a-82e5-81fccbf148e9 tempest-VolumesDeleteCascade-510417396 None] Creating offline snapshot 4e07b257-ed3e-4281-b2a1-125503489aad of volume 1355777b-bfb3-4d84-a8aa-d36063b78e54 {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:08:52 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Volume volume-b65aa8b4-494f-42b2-a371-c5413a2f7442 (b65aa8b4-494f-42b2-a371-c5413a2f7442): created successfully
Jul 03 13:08:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829de806-7177-4b9f-96db-a0e5a4091e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Flow 'volume_create_manager' (45bcd5d9-9bc7-436b-9e18-2b1eb3833382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:08:52 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d1f986-f5f2-44c3-adc5-efe6a5d453a4]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ad3cf594-bb0f-4f4a-82e5-81fccbf148e9 tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:52 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-e633d7a9-f29a-48fc-8081-50e793313134 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Created volume successfully.
Jul 03 13:08:53 devstack sudo[96745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790
Jul 03 13:08:53 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:53 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2a29ce92-d411-4c2f-8f9f-e390460ef6d9 tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca.ebd72356-3614-471c-b3e9-3f446fdd9d03" returned: 0 in 0.802s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:53 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2a29ce92-d411-4c2f-8f9f-e390460ef6d9 tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-ebd72356-3614-471c-b3e9-3f446fdd9d03" released by "_delete_snapshot" :: held 3.894s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:08:53 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2a29ce92-d411-4c2f-8f9f-e390460ef6d9 tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-b262739a-e9df-4031-a8c1-3a82936e62ca" released by "delete_snapshot" :: held 3.930s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:08:53 devstack cinder-volume[86837]: WARNING cinder.quota [None req-2a29ce92-d411-4c2f-8f9f-e390460ef6d9 tempest-GroupSnapshotsTest-926850929 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-291527080 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-291527080, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:08:53 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-2a29ce92-d411-4c2f-8f9f-e390460ef6d9 tempest-GroupSnapshotsTest-926850929 None] Created reservations ['f0d80f66-f48c-4bbf-af32-60c89a82eb78', '94f2cc93-55f6-4742-bd3a-48598339b801', '1c843529-68a4-4eb9-a93a-2e082d0c0403', '2e9c5055-b689-4708-8bf5-d6e5b0f7e51c'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:08:53 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-2a29ce92-d411-4c2f-8f9f-e390460ef6d9 tempest-GroupSnapshotsTest-926850929 None] group_snapshot 62336c1a-5cab-4008-a0ab-b5cead666de9: deleted successfully
Jul 03 13:08:53 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ad3cf594-bb0f-4f4a-82e5-81fccbf148e9 tempest-VolumesDeleteCascade-510417396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790" returned: 0 in 0.915s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:53 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-ad3cf594-bb0f-4f4a-82e5-81fccbf148e9 tempest-VolumesDeleteCascade-510417396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1355777b-bfb3-4d84-a8aa-d36063b78e54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:08:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ad3cf594-bb0f-4f4a-82e5-81fccbf148e9 tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.4e07b257-ed3e-4281-b2a1-125503489aad 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:53 devstack sudo[96754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.4e07b257-ed3e-4281-b2a1-125503489aad 1G
Jul 03 13:08:53 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:54 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8d92507f-450d-4373-9335-5bb685a8059b tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "cinder-quobyte-b262739a-e9df-4031-a8c1-3a82936e62ca" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:08:54 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8d92507f-450d-4373-9335-5bb685a8059b tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-b262739a-e9df-4031-a8c1-3a82936e62ca" acquired by "delete_volume" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:08:54 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f375c2-a46c-4796-b5de-c397ba62ccde]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8d92507f-450d-4373-9335-5bb685a8059b tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:54 devstack sudo[96765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca
Jul 03 13:08:54 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:54 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ad3cf594-bb0f-4f4a-82e5-81fccbf148e9 tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.4e07b257-ed3e-4281-b2a1-125503489aad 1G" returned: 0 in 0.963s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ad3cf594-bb0f-4f4a-82e5-81fccbf148e9 tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.4e07b257-ed3e-4281-b2a1-125503489aad {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:54 devstack sudo[96777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.4e07b257-ed3e-4281-b2a1-125503489aad
Jul 03 13:08:54 devstack sudo[96777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:55 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8d92507f-450d-4373-9335-5bb685a8059b tempest-GroupSnapshotsTest-926850929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca" returned: 0 in 0.830s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8d92507f-450d-4373-9335-5bb685a8059b tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:55 devstack sudo[96782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca
Jul 03 13:08:55 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:55 devstack sudo[96777]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ad3cf594-bb0f-4f4a-82e5-81fccbf148e9 tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.4e07b257-ed3e-4281-b2a1-125503489aad" returned: 0 in 0.787s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:55 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-ad3cf594-bb0f-4f4a-82e5-81fccbf148e9 tempest-VolumesDeleteCascade-510417396 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.4e07b257-ed3e-4281-b2a1-125503489aad is being set with open permissions: ugo+rw
Jul 03 13:08:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ad3cf594-bb0f-4f4a-82e5-81fccbf148e9 tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.4e07b257-ed3e-4281-b2a1-125503489aad {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:55 devstack sudo[96788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.4e07b257-ed3e-4281-b2a1-125503489aad
Jul 03 13:08:55 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:55 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8d92507f-450d-4373-9335-5bb685a8059b tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b262739a-e9df-4031-a8c1-3a82936e62ca" returned: 0 in 0.761s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8d92507f-450d-4373-9335-5bb685a8059b tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-b262739a-e9df-4031-a8c1-3a82936e62ca" released by "delete_volume" :: held 1.703s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:08:55 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-8d92507f-450d-4373-9335-5bb685a8059b tempest-GroupSnapshotsTest-926850929 None] Created reservations ['516fedec-4541-43a0-83d7-d9f30e9d4ba8'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:08:55 devstack cinder-volume[86837]: WARNING cinder.db.api [None req-8d92507f-450d-4373-9335-5bb685a8059b tempest-GroupSnapshotsTest-926850929 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-291527080']
Jul 03 13:08:55 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-8d92507f-450d-4373-9335-5bb685a8059b tempest-GroupSnapshotsTest-926850929 None] Created reservations ['f83cc329-2831-4d65-8e3b-bab7f83d2186', '5a5473cb-a3fc-4b70-96fb-86d1763bc285', '4ac783df-6300-4ae0-8ef5-29c6d1cb4aad', '33cad584-44c9-42f5-bf55-beb2d320dc4f'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:08:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8d92507f-450d-4373-9335-5bb685a8059b tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8d92507f-450d-4373-9335-5bb685a8059b tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8d92507f-450d-4373-9335-5bb685a8059b tempest-GroupSnapshotsTest-926850929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:08:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8d92507f-450d-4373-9335-5bb685a8059b tempest-GroupSnapshotsTest-926850929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:08:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8d92507f-450d-4373-9335-5bb685a8059b tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8d92507f-450d-4373-9335-5bb685a8059b tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:56 devstack sudo[96791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:08:56 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:56 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ad3cf594-bb0f-4f4a-82e5-81fccbf148e9 tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.4e07b257-ed3e-4281-b2a1-125503489aad" returned: 0 in 0.839s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ad3cf594-bb0f-4f4a-82e5-81fccbf148e9 tempest-VolumesDeleteCascade-510417396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.688s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:56 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-ad3cf594-bb0f-4f4a-82e5-81fccbf148e9 tempest-VolumesDeleteCascade-510417396 None] Create snapshot completed successfully
Jul 03 13:08:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-e16ed213-a54d-4497-ae5d-8603db7df2bb req-2c506164-7248-4a7e-a01a-f09cc849642d tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-e16ed213-a54d-4497-ae5d-8603db7df2bb req-2c506164-7248-4a7e-a01a-f09cc849642d tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:56 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffbb74f-7411-455d-8df5-23b90c8c5c38]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-e16ed213-a54d-4497-ae5d-8603db7df2bb req-2c506164-7248-4a7e-a01a-f09cc849642d tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b65aa8b4-494f-42b2-a371-c5413a2f7442 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:57 devstack sudo[96803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b65aa8b4-494f-42b2-a371-c5413a2f7442
Jul 03 13:08:57 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:57 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8d92507f-450d-4373-9335-5bb685a8059b tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.931s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:57 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-8d92507f-450d-4373-9335-5bb685a8059b tempest-GroupSnapshotsTest-926850929 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:08:57 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-8d92507f-450d-4373-9335-5bb685a8059b tempest-GroupSnapshotsTest-926850929 None] Delete group completed successfully.
Jul 03 13:08:57 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-398303da-8aa4-4e1e-ba48-23254e3f25fd tempest-GroupSnapshotsTest-926850929 None] Group tempest-GroupSnapshotsTest-Group-1831056898: creating
Jul 03 13:08:57 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-398303da-8aa4-4e1e-ba48-23254e3f25fd tempest-GroupSnapshotsTest-926850929 None] Group tempest-GroupSnapshotsTest-Group-1831056898: created successfully
Jul 03 13:08:57 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-398303da-8aa4-4e1e-ba48-23254e3f25fd tempest-GroupSnapshotsTest-926850929 None] Create group completed successfully.
Jul 03 13:08:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "cinder-1355777b-bfb3-4d84-a8aa-d36063b78e54-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:08:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-1355777b-bfb3-4d84-a8aa-d36063b78e54-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:08:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Performing cascade delete. {{(pid=86837) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 03 13:08:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "cinder-4e07b257-ed3e-4281-b2a1-125503489aad-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:08:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-4e07b257-ed3e-4281-b2a1-125503489aad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:08:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "cinder-quobyte-1355777b-bfb3-4d84-a8aa-d36063b78e54" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:08:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-quobyte-1355777b-bfb3-4d84-a8aa-d36063b78e54" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:08:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "cinder-quobyte-4e07b257-ed3e-4281-b2a1-125503489aad" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:08:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-quobyte-4e07b257-ed3e-4281-b2a1-125503489aad" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:08:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Deleting offline snapshot 4e07b257-ed3e-4281-b2a1-125503489aad of volume 1355777b-bfb3-4d84-a8aa-d36063b78e54 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:08:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] snapshot_file for this snap is: volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.4e07b257-ed3e-4281-b2a1-125503489aad {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:08:57 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde8cd27-aee7-480b-96b3-1852e601ad55]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.4e07b257-ed3e-4281-b2a1-125503489aad {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:57 devstack sudo[96805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.4e07b257-ed3e-4281-b2a1-125503489aad
Jul 03 13:08:57 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:57 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-e16ed213-a54d-4497-ae5d-8603db7df2bb req-2c506164-7248-4a7e-a01a-f09cc849642d tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b65aa8b4-494f-42b2-a371-c5413a2f7442" returned: 0 in 0.954s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-e16ed213-a54d-4497-ae5d-8603db7df2bb req-2c506164-7248-4a7e-a01a-f09cc849642d tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.985s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-e16ed213-a54d-4497-ae5d-8603db7df2bb req-2c506164-7248-4a7e-a01a-f09cc849642d tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db', 'name': 'volume-b65aa8b4-494f-42b2-a371-c5413a2f7442', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f349499-5851-42a8-8ecb-a442ef959848', 'enforce_multipath': True} {{(pid=86837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 13:08:57 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-e16ed213-a54d-4497-ae5d-8603db7df2bb req-2c506164-7248-4a7e-a01a-f09cc849642d tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] attachment_update completed successfully.
Jul 03 13:08:58 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root
Jul 03 13:08:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.4e07b257-ed3e-4281-b2a1-125503489aad" returned: 0 in 1.157s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:08:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1355777b-bfb3-4d84-a8aa-d36063b78e54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:08:58 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[60006118-1470-41da-9e56-a2b1b4f2d50f]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:08:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:58 devstack sudo[96889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790
Jul 03 13:08:58 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:08:59 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:08:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Flow 'volume_create_manager' (c1c6a449-7ff9-4e7a-83de-c40efb972dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:08:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae239815-b29d-4453-b066-50b317e79a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae239815-b29d-4453-b066-50b317e79a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1330722933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9929e1dd-c0da-45c2-87f0-bd3b9375e0bb,host='devstack@QuobyteHD#QuobyteHD',id=5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='619bde85acf74a0dbf92c75c3920ce29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:08:59Z,use_quota=True,user_id='01db4f9516244a859e4161f1c41ba96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24328a08-9779-4f8f-9908-212e97544fb1),volume_type_id=24328a08-9779-4f8f-9908-212e97544fb1)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81c16523-9071-462b-8c1d-998b235e48a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81c16523-9071-462b-8c1d-998b235e48a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d8b8506-5623-4cb3-a4e9-45f1e0fc2d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d8b8506-5623-4cb3-a4e9-45f1e0fc2d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd', 'volume_name': 'volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90f377e-a40b-436c-b564-a5e0583f4f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90f377e-a40b-436c-b564-a5e0583f4f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:08:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (238a8505-6185-458d-a91f-dbb9942d98a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:08:59 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Volume 5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd', 'volume_size': 1}
Jul 03 13:08:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9929e1dd-c0da-45c2-87f0-bd3b9375e0bb,created_at=2026-07-03T11:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1330722933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9929e1dd-c0da-45c2-87f0-bd3b9375e0bb,host='devstack@QuobyteHD#QuobyteHD',id=5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='619bde85acf74a0dbf92c75c3920ce29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:08:59Z,use_quota=True,user_id='01db4f9516244a859e4161f1c41ba96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24328a08-9779-4f8f-9908-212e97544fb1),volume_type_id=24328a08-9779-4f8f-9908-212e97544fb1)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:08:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Creating volume 5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:08:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:08:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:08:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:08:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:08:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:08:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:08:59 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:08:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:08:59 devstack sudo[96896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd 1073741824
Jul 03 13:08:59 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:00 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790" returned: 0 in 1.417s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1355777b-bfb3-4d84-a8aa-d36063b78e54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:09:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.4e07b257-ed3e-4281-b2a1-125503489aad {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:00 devstack sudo[97272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.4e07b257-ed3e-4281-b2a1-125503489aad
Jul 03 13:09:00 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:00 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd 1073741824" returned: 0 in 1.836s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:01 devstack sudo[97291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd
Jul 03 13:09:01 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:01 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.4e07b257-ed3e-4281-b2a1-125503489aad" returned: 0 in 1.279s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.4e07b257-ed3e-4281-b2a1-125503489aad {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:01 devstack sudo[97298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.4e07b257-ed3e-4281-b2a1-125503489aad
Jul 03 13:09:01 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:01 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd" returned: 0 in 0.746s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:01 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] <== create_volume: return (2627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:09:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.631s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:01 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (238a8505-6185-458d-a91f-dbb9942d98a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:01 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f076cb-0cbf-4db9-b5eb-5bbb25dfb634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:01 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Volume volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd (5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd): created successfully
Jul 03 13:09:01 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f076cb-0cbf-4db9-b5eb-5bbb25dfb634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:01 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Flow 'volume_create_manager' (c1c6a449-7ff9-4e7a-83de-c40efb972dfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:09:01 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-9419da0f-0864-4393-adac-3a24d887700e tempest-GroupSnapshotsTest-926850929 None] Created volume successfully.
Jul 03 13:09:02 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.4e07b257-ed3e-4281-b2a1-125503489aad" returned: 0 in 0.877s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:02 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-quobyte-4e07b257-ed3e-4281-b2a1-125503489aad" released by "_delete_snapshot" :: held 4.867s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:02 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-quobyte-1355777b-bfb3-4d84-a8aa-d36063b78e54" released by "delete_snapshot" :: held 4.891s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:02 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Created reservations ['69d7025c-2f6c-4f4a-8863-0f09ec91d870', 'e34763f3-e294-4ac8-af14-183ba31e4141', '93cdc468-ec0c-439c-8c3d-c44ab23dc951', 'edce0c0a-11c5-46c8-8b19-c4a7a057bf6f'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:09:02 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Delete snapshot completed successfully.
Jul 03 13:09:02 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-4e07b257-ed3e-4281-b2a1-125503489aad-delete_snapshot" released by "delete_snapshot" :: held 5.095s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:02 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "cinder-91858036-2578-4b0d-8a42-661c0bf8c790-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:02 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-91858036-2578-4b0d-8a42-661c0bf8c790-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:02 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "cinder-quobyte-1355777b-bfb3-4d84-a8aa-d36063b78e54" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:02 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-quobyte-1355777b-bfb3-4d84-a8aa-d36063b78e54" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:02 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "cinder-quobyte-91858036-2578-4b0d-8a42-661c0bf8c790" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:02 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-quobyte-91858036-2578-4b0d-8a42-661c0bf8c790" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Deleting offline snapshot 91858036-2578-4b0d-8a42-661c0bf8c790 of volume 1355777b-bfb3-4d84-a8aa-d36063b78e54 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:09:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] snapshot_file for this snap is: volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:09:02 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a087df28-ca9a-4d02-8204-8d7cbb1e678a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:02 devstack sudo[97304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790
Jul 03 13:09:02 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:03 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:09:03 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Flow 'volume_create_manager' (1e03c185-929e-4a5c-95f1-debef4c753c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:09:03 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e57f9f6-f29a-442d-9bc7-c0585f4946b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:03 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e57f9f6-f29a-442d-9bc7-c0585f4946b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1034315442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9929e1dd-c0da-45c2-87f0-bd3b9375e0bb,host='devstack@QuobyteHD#QuobyteHD',id=b90b7abc-720f-45c7-8ef9-f80d488e496d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='619bde85acf74a0dbf92c75c3920ce29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:09:04Z,use_quota=True,user_id='01db4f9516244a859e4161f1c41ba96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24328a08-9779-4f8f-9908-212e97544fb1),volume_type_id=24328a08-9779-4f8f-9908-212e97544fb1)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:03 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b700e65-c440-46d5-ad2e-bfb7136c6366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:03 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b700e65-c440-46d5-ad2e-bfb7136c6366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:03 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb12950-649e-4614-bbd4-c62020d76c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:03 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb12950-649e-4614-bbd4-c62020d76c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b90b7abc-720f-45c7-8ef9-f80d488e496d', 'volume_name': 'volume-b90b7abc-720f-45c7-8ef9-f80d488e496d', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:03 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f1e2da-ba1a-40dd-9a04-51faa92fae2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:03 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f1e2da-ba1a-40dd-9a04-51faa92fae2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:03 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23c45e6e-3084-464d-b1a1-6ef3b1511310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:03 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Volume b90b7abc-720f-45c7-8ef9-f80d488e496d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b90b7abc-720f-45c7-8ef9-f80d488e496d', 'volume_size': 1}
Jul 03 13:09:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:03 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9929e1dd-c0da-45c2-87f0-bd3b9375e0bb,created_at=2026-07-03T11:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1034315442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9929e1dd-c0da-45c2-87f0-bd3b9375e0bb,host='devstack@QuobyteHD#QuobyteHD',id=b90b7abc-720f-45c7-8ef9-f80d488e496d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='619bde85acf74a0dbf92c75c3920ce29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:09:04Z,use_quota=True,user_id='01db4f9516244a859e4161f1c41ba96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24328a08-9779-4f8f-9908-212e97544fb1),volume_type_id=24328a08-9779-4f8f-9908-212e97544fb1)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:09:03 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Creating volume b90b7abc-720f-45c7-8ef9-f80d488e496d {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:09:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:03 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:09:03 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:09:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:03 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:09:03 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:09:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:03 devstack sudo[97309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d 1073741824
Jul 03 13:09:03 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:03 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790" returned: 0 in 1.336s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:03 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1355777b-bfb3-4d84-a8aa-d36063b78e54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:09:04 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fa50c6-f260-462a-a5ce-7df43ad23856]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:04 devstack sudo[97311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54
Jul 03 13:09:04 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:04 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d 1073741824" returned: 0 in 1.181s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:05 devstack sudo[97321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d
Jul 03 13:09:05 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:05 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54" returned: 0 in 1.223s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:05 devstack sudo[97323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790
Jul 03 13:09:05 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:06 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d" returned: 0 in 0.888s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] <== create_volume: return (2314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:09:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.317s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23c45e6e-3084-464d-b1a1-6ef3b1511310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b90b7abc-720f-45c7-8ef9-f80d488e496d', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a77d946-db94-41d2-82c8-1b75bc0d2c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:06 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Volume volume-b90b7abc-720f-45c7-8ef9-f80d488e496d (b90b7abc-720f-45c7-8ef9-f80d488e496d): created successfully
Jul 03 13:09:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a77d946-db94-41d2-82c8-1b75bc0d2c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Flow 'volume_create_manager' (1e03c185-929e-4a5c-95f1-debef4c753c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:09:06 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-f79ced93-b2da-4d9d-b574-0fe007a33b52 tempest-GroupSnapshotsTest-926850929 None] Created volume successfully.
Jul 03 13:09:06 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790" returned: 0 in 0.954s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:06 devstack sudo[97330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790
Jul 03 13:09:06 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:06 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-61484434-a065-4584-90d5-9d0d60ae6070 tempest-GroupSnapshotsTest-926850929 None] Update group completed successfully.
Jul 03 13:09:06 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-fedebf9b-3a57-474b-acd5-7eeb12e90aca req-dc99df0a-4e39-4da1-80b1-8974b8a91df3 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Terminate volume connection completed successfully.
Jul 03 13:09:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-fedebf9b-3a57-474b-acd5-7eeb12e90aca req-dc99df0a-4e39-4da1-80b1-8974b8a91df3 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Deleting attachment 4f349499-5851-42a8-8ecb-a442ef959848. {{(pid=86837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:09:07 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54.91858036-2578-4b0d-8a42-661c0bf8c790" returned: 0 in 0.788s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-quobyte-91858036-2578-4b0d-8a42-661c0bf8c790" released by "_delete_snapshot" :: held 4.461s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-quobyte-1355777b-bfb3-4d84-a8aa-d36063b78e54" released by "delete_snapshot" :: held 4.485s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:07 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Created reservations ['a4acab07-0247-4bb5-8b92-3a0118b0bdaf', '8ceadd7d-640e-4333-b36d-3a479bbd8bc1', 'b59b543a-9bcc-4e34-ad92-aac06d3af076', '1a6ac1c5-faff-47e4-9ce9-2ab839c302f8'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:09:07 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Delete snapshot completed successfully.
Jul 03 13:09:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-91858036-2578-4b0d-8a42-661c0bf8c790-delete_snapshot" released by "delete_snapshot" :: held 4.636s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Snapshots deleted, issuing volume delete {{(pid=86837) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 03 13:09:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "cinder-quobyte-1355777b-bfb3-4d84-a8aa-d36063b78e54" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-quobyte-1355777b-bfb3-4d84-a8aa-d36063b78e54" acquired by "delete_volume" :: waited 0.016s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:07 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c486a4a5-52de-4790-aa32-8116a62b401c]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:07 devstack sudo[97360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54
Jul 03 13:09:07 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:07 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-723706f0-a392-4715-bfbb-88f6269006cb tempest-GroupSnapshotsTest-926850929 None] Update group completed successfully.
Jul 03 13:09:08 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54" returned: 0 in 0.938s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:08 devstack sudo[97365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54
Jul 03 13:09:08 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:09 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1355777b-bfb3-4d84-a8aa-d36063b78e54" returned: 0 in 0.864s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-quobyte-1355777b-bfb3-4d84-a8aa-d36063b78e54" released by "delete_volume" :: held 1.893s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-66087326-0f01-434f-b356-d2f32fc6b618 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Acquiring lock "cinder-b65aa8b4-494f-42b2-a371-c5413a2f7442-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:09 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-79afa803-60cc-4042-9149-3f6d126f4b72 tempest-GroupSnapshotsTest-926850929 None] Update group completed successfully.
Jul 03 13:09:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-66087326-0f01-434f-b356-d2f32fc6b618 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Lock "cinder-b65aa8b4-494f-42b2-a371-c5413a2f7442-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:09 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Created reservations ['e30a64aa-200b-49b7-a73f-4ad3bf0388e4', '5c7c93c7-7d46-48b5-888d-e1c9d6c51f1e', '595c7054-cd2b-4e65-aec6-9edbe2bf0a6e', 'b67be33d-4d3f-40d4-bf8a-2e8b92faa48f'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:09:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-66087326-0f01-434f-b356-d2f32fc6b618 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Acquiring lock "cinder-quobyte-b65aa8b4-494f-42b2-a371-c5413a2f7442" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-66087326-0f01-434f-b356-d2f32fc6b618 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Lock "cinder-quobyte-b65aa8b4-494f-42b2-a371-c5413a2f7442" acquired by "delete_volume" :: waited 0.028s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:09 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[b699a8cc-fa06-464e-a5c8-db2530b44afd]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-66087326-0f01-434f-b356-d2f32fc6b618 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b65aa8b4-494f-42b2-a371-c5413a2f7442 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:09:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:09:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:09 devstack sudo[97369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:09:09 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:09 devstack sudo[97368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b65aa8b4-494f-42b2-a371-c5413a2f7442
Jul 03 13:09:09 devstack sudo[97368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:10 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.787s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:10 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:09:10 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Deleted volume successfully.
Jul 03 13:09:10 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7cc63af4-cf47-4e3e-8c51-0e291b832d15 tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-1355777b-bfb3-4d84-a8aa-d36063b78e54-delete_volume" released by "delete_volume" :: held 12.887s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:10 devstack sudo[97368]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-66087326-0f01-434f-b356-d2f32fc6b618 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b65aa8b4-494f-42b2-a371-c5413a2f7442" returned: 0 in 1.063s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-66087326-0f01-434f-b356-d2f32fc6b618 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b65aa8b4-494f-42b2-a371-c5413a2f7442 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:10 devstack sudo[97376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b65aa8b4-494f-42b2-a371-c5413a2f7442
Jul 03 13:09:10 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:10 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-52348597-aec9-4af1-8eb8-ae5b7550998f tempest-GroupSnapshotsTest-926850929 None] Update group completed successfully.
Jul 03 13:09:10 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:09:10 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Flow 'volume_create_manager' (ba26a447-ff2f-40e7-a415-289213f5916a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:09:10 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c50f4ed-df8d-450c-a9b3-5e66a7539a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c50f4ed-df8d-450c-a9b3-5e66a7539a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1113236070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b557d3-9356-4e2c-b74c-e192aa487a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d107f18b9194cc7b68335c6762dd2bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:09:11Z,use_quota=True,user_id='1f52404ad05e4b7fbffec77f7c864024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3479c75d-f0d9-43ad-b636-87b05e2fe407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3479c75d-f0d9-43ad-b636-87b05e2fe407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (751e00d2-b643-458e-a571-781b63bb267c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (751e00d2-b643-458e-a571-781b63bb267c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18b557d3-9356-4e2c-b74c-e192aa487a32', 'volume_name': 'volume-18b557d3-9356-4e2c-b74c-e192aa487a32', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (156d920d-3b9c-474e-920e-5dc2c915db50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (156d920d-3b9c-474e-920e-5dc2c915db50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db2e917a-2cc0-49aa-8cfa-f256d4627907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:11 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Volume 18b557d3-9356-4e2c-b74c-e192aa487a32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18b557d3-9356-4e2c-b74c-e192aa487a32', 'volume_size': 1}
Jul 03 13:09:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1113236070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b557d3-9356-4e2c-b74c-e192aa487a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d107f18b9194cc7b68335c6762dd2bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:09:11Z,use_quota=True,user_id='1f52404ad05e4b7fbffec77f7c864024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:09:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Creating volume 18b557d3-9356-4e2c-b74c-e192aa487a32 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:09:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:09:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:09:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:09:11 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:09:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:11 devstack sudo[97378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32 1073741824
Jul 03 13:09:11 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:11 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-66087326-0f01-434f-b356-d2f32fc6b618 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b65aa8b4-494f-42b2-a371-c5413a2f7442" returned: 0 in 0.853s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:11 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-66087326-0f01-434f-b356-d2f32fc6b618 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Lock "cinder-quobyte-b65aa8b4-494f-42b2-a371-c5413a2f7442" released by "delete_volume" :: held 1.971s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:11 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-66087326-0f01-434f-b356-d2f32fc6b618 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Created reservations ['3e487c08-35e4-4447-a97f-81ed29b2ef90', '64d0e8c9-2564-486e-87f1-277febb63211', 'e39b6ce0-73de-4c8f-bc7a-ed6e996d0859', '0a8fa5fd-d63d-4831-bcac-a33623e68417'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:09:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-66087326-0f01-434f-b356-d2f32fc6b618 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-66087326-0f01-434f-b356-d2f32fc6b618 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-66087326-0f01-434f-b356-d2f32fc6b618 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:09:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-66087326-0f01-434f-b356-d2f32fc6b618 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:09:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-66087326-0f01-434f-b356-d2f32fc6b618 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-66087326-0f01-434f-b356-d2f32fc6b618 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:11 devstack sudo[97381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:09:11 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:12 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] GroupSnapshot ceda80ba-41d8-41a9-a6db-7959c3d63af3: creating.
Jul 03 13:09:12 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] Group snapshot ceda80ba-41d8-41a9-a6db-7959c3d63af3: creating. {{(pid=86837) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 03 13:09:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:12 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-66087326-0f01-434f-b356-d2f32fc6b618 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.067s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:12 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-66087326-0f01-434f-b356-d2f32fc6b618 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:09:12 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:12 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-66087326-0f01-434f-b356-d2f32fc6b618 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Deleted volume successfully.
Jul 03 13:09:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32 1073741824" returned: 0 in 1.400s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-66087326-0f01-434f-b356-d2f32fc6b618 tempest-TestServerVolumeAttachScenarioOldVersion-890467507 None] Lock "cinder-b65aa8b4-494f-42b2-a371-c5413a2f7442-delete_volume" released by "delete_volume" :: held 3.313s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:12 devstack sudo[97387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32
Jul 03 13:09:12 devstack sudo[97387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:13 devstack sudo[97387]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32" returned: 0 in 1.044s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:13 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] <== create_volume: return (2497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:09:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.500s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.189s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:13 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] Creating offline snapshot 085621f0-fc0e-4d80-81dd-ffa88ca7f928 of volume b90b7abc-720f-45c7-8ef9-f80d488e496d {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:09:13 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db2e917a-2cc0-49aa-8cfa-f256d4627907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18b557d3-9356-4e2c-b74c-e192aa487a32', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:13 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0341ce9-61de-4bc6-a125-87cc1ccbca0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:13 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[de092a7c-95b5-40de-a191-114bf8411bbb]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:13 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Volume volume-18b557d3-9356-4e2c-b74c-e192aa487a32 (18b557d3-9356-4e2c-b74c-e192aa487a32): created successfully
Jul 03 13:09:13 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0341ce9-61de-4bc6-a125-87cc1ccbca0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:13 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Flow 'volume_create_manager' (ba26a447-ff2f-40e7-a415-289213f5916a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:09:13 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-5bfaaf48-7281-40bd-9171-5d77de7bedb4 tempest-VolumesDeleteCascade-510417396 None] Created volume successfully.
Jul 03 13:09:13 devstack sudo[97432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d
Jul 03 13:09:13 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4ea3937a-52a0-4dad-89a3-3610ce024a5a tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:14 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d" returned: 0 in 1.017s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d.085621f0-fc0e-4d80-81dd-ffa88ca7f928 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:14 devstack sudo[97443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d.085621f0-fc0e-4d80-81dd-ffa88ca7f928 1G
Jul 03 13:09:14 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:09:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:09:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:09:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:14 devstack sudo[97446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:09:14 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:15 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d.085621f0-fc0e-4d80-81dd-ffa88ca7f928 1G" returned: 0 in 0.963s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b90b7abc-720f-45c7-8ef9-f80d488e496d -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d.085621f0-fc0e-4d80-81dd-ffa88ca7f928 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:15 devstack sudo[97454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b90b7abc-720f-45c7-8ef9-f80d488e496d -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d.085621f0-fc0e-4d80-81dd-ffa88ca7f928
Jul 03 13:09:15 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:15 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.781s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:15 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:09:15 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:09:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 28 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:09:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>, <Thread(tpool_thread_0, started daemon 134850092431040)>, <Thread(tpool_thread_1, started daemon 134850084021952)>, <Thread(tpool_thread_2, started daemon 134850075612864)>, <Thread(tpool_thread_3, started daemon 134850067203776)>, <Thread(tpool_thread_4, started daemon 134850058794688)>, <Thread(tpool_thread_5, started daemon 134850050385600)>, <Thread(tpool_thread_6, started daemon 134850041976512)>, <Thread(tpool_thread_7, started daemon 134850033567424)>, <Thread(tpool_thread_8, started daemon 134850025158336)>, <Thread(tpool_thread_9, started daemon 134850016749248)>, <Thread(tpool_thread_10, started daemon 134850008340160)>, <Thread(tpool_thread_11, started daemon 134849999931072)>, <Thread(tpool_thread_12, started daemon 134849991521984)>, <Thread(tpool_thread_13, started daemon 134849983112896)>, <Thread(tpool_thread_14, started daemon 134849974703808)>, <Thread(tpool_thread_15, started daemon 134849966294720)>, <Thread(tpool_thread_16, started daemon 134849957885632)>, <Thread(tpool_thread_17, started daemon 134849949476544)>, <Thread(tpool_thread_18, started daemon 134849941067456)>, <Thread(tpool_thread_19, started daemon 134849932658368)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:09:16 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b90b7abc-720f-45c7-8ef9-f80d488e496d -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d.085621f0-fc0e-4d80-81dd-ffa88ca7f928" returned: 0 in 0.766s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:16 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d.085621f0-fc0e-4d80-81dd-ffa88ca7f928 is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 13:09:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d.085621f0-fc0e-4d80-81dd-ffa88ca7f928 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:16 devstack sudo[97493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d.085621f0-fc0e-4d80-81dd-ffa88ca7f928
Jul 03 13:09:16 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:17 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d.085621f0-fc0e-4d80-81dd-ffa88ca7f928" returned: 0 in 0.739s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:17 devstack sudo[97498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d.info
Jul 03 13:09:17 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:17 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d.info" returned: 0 in 0.694s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:17 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 13:09:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:17 devstack sudo[97501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d.info
Jul 03 13:09:17 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:18 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d.info" returned: 0 in 0.677s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.991s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:18 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] Creating offline snapshot cda51a9b-97e8-4aa5-834e-ccc3f550efab of volume 5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:09:18 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f3c3df-d96d-4675-b3f5-f01f50a5e331]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:18 devstack sudo[97504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd
Jul 03 13:09:18 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:19 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd" returned: 0 in 0.863s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd.cda51a9b-97e8-4aa5-834e-ccc3f550efab 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:19 devstack sudo[97509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd.cda51a9b-97e8-4aa5-834e-ccc3f550efab 1G
Jul 03 13:09:19 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:20 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd.cda51a9b-97e8-4aa5-834e-ccc3f550efab 1G" returned: 0 in 1.046s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd.cda51a9b-97e8-4aa5-834e-ccc3f550efab {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:20 devstack sudo[97514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd.cda51a9b-97e8-4aa5-834e-ccc3f550efab
Jul 03 13:09:20 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:21 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd.cda51a9b-97e8-4aa5-834e-ccc3f550efab" returned: 0 in 0.779s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:21 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd.cda51a9b-97e8-4aa5-834e-ccc3f550efab is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 13:09:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd.cda51a9b-97e8-4aa5-834e-ccc3f550efab {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:21 devstack sudo[97520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd.cda51a9b-97e8-4aa5-834e-ccc3f550efab
Jul 03 13:09:21 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:22 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd.cda51a9b-97e8-4aa5-834e-ccc3f550efab" returned: 0 in 0.799s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:22 devstack sudo[97526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd.info
Jul 03 13:09:22 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:22 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd.info" returned: 0 in 0.766s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:22 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 13:09:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:22 devstack sudo[97534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd.info
Jul 03 13:09:22 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:23 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd.info" returned: 0 in 0.794s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.153s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4ea3937a-52a0-4dad-89a3-3610ce024a5a tempest-VolumesDeleteCascade-510417396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.189s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-4ea3937a-52a0-4dad-89a3-3610ce024a5a tempest-VolumesDeleteCascade-510417396 None] Creating offline snapshot dd16ff5d-9e80-4577-9145-44181cb177b4 of volume 18b557d3-9356-4e2c-b74c-e192aa487a32 {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:09:23 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad784d4-2da1-49e6-9590-9a7559bc1b6a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4ea3937a-52a0-4dad-89a3-3610ce024a5a tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:24 devstack sudo[97540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32
Jul 03 13:09:24 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:24 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-3c44b103-643e-4477-a297-3d2efc031bd8 tempest-GroupSnapshotsTest-926850929 None] group_snapshot ceda80ba-41d8-41a9-a6db-7959c3d63af3: created successfully
Jul 03 13:09:24 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] group_snapshot ceda80ba-41d8-41a9-a6db-7959c3d63af3: deleting
Jul 03 13:09:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] group_snapshot ceda80ba-41d8-41a9-a6db-7959c3d63af3: deleting {{(pid=86837) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 03 13:09:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "cinder-quobyte-b90b7abc-720f-45c7-8ef9-f80d488e496d" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-b90b7abc-720f-45c7-8ef9-f80d488e496d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "cinder-quobyte-085621f0-fc0e-4d80-81dd-ffa88ca7f928" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-085621f0-fc0e-4d80-81dd-ffa88ca7f928" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] Deleting offline snapshot 085621f0-fc0e-4d80-81dd-ffa88ca7f928 of volume b90b7abc-720f-45c7-8ef9-f80d488e496d {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:09:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] snapshot_file for this snap is: volume-b90b7abc-720f-45c7-8ef9-f80d488e496d.085621f0-fc0e-4d80-81dd-ffa88ca7f928 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:09:24 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[750cd998-bd03-4909-ab5e-6d712084a668]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d.085621f0-fc0e-4d80-81dd-ffa88ca7f928 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:24 devstack sudo[97542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d.085621f0-fc0e-4d80-81dd-ffa88ca7f928
Jul 03 13:09:24 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:24 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4ea3937a-52a0-4dad-89a3-3610ce024a5a tempest-VolumesDeleteCascade-510417396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32" returned: 0 in 1.208s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4ea3937a-52a0-4dad-89a3-3610ce024a5a tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.dd16ff5d-9e80-4577-9145-44181cb177b4 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:25 devstack sudo[97548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.dd16ff5d-9e80-4577-9145-44181cb177b4 1G
Jul 03 13:09:25 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:25 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d.085621f0-fc0e-4d80-81dd-ffa88ca7f928" returned: 0 in 1.444s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b90b7abc-720f-45c7-8ef9-f80d488e496d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:09:25 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[10994e9b-922a-4847-b620-3658f03bd83a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:26 devstack sudo[97595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d
Jul 03 13:09:26 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:26 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4ea3937a-52a0-4dad-89a3-3610ce024a5a tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.dd16ff5d-9e80-4577-9145-44181cb177b4 1G" returned: 0 in 1.400s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4ea3937a-52a0-4dad-89a3-3610ce024a5a tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18b557d3-9356-4e2c-b74c-e192aa487a32 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.dd16ff5d-9e80-4577-9145-44181cb177b4 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:26 devstack sudo[97597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18b557d3-9356-4e2c-b74c-e192aa487a32 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.dd16ff5d-9e80-4577-9145-44181cb177b4
Jul 03 13:09:26 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:27 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d" returned: 0 in 1.142s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d.085621f0-fc0e-4d80-81dd-ffa88ca7f928 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:27 devstack sudo[97604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d.085621f0-fc0e-4d80-81dd-ffa88ca7f928
Jul 03 13:09:27 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:27 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4ea3937a-52a0-4dad-89a3-3610ce024a5a tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18b557d3-9356-4e2c-b74c-e192aa487a32 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.dd16ff5d-9e80-4577-9145-44181cb177b4" returned: 0 in 0.974s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:27 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-4ea3937a-52a0-4dad-89a3-3610ce024a5a tempest-VolumesDeleteCascade-510417396 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.dd16ff5d-9e80-4577-9145-44181cb177b4 is being set with open permissions: ugo+rw
Jul 03 13:09:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4ea3937a-52a0-4dad-89a3-3610ce024a5a tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.dd16ff5d-9e80-4577-9145-44181cb177b4 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:27 devstack sudo[97609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.dd16ff5d-9e80-4577-9145-44181cb177b4
Jul 03 13:09:27 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:28 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4ea3937a-52a0-4dad-89a3-3610ce024a5a tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.dd16ff5d-9e80-4577-9145-44181cb177b4" returned: 0 in 1.006s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:28 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4ea3937a-52a0-4dad-89a3-3610ce024a5a tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d.085621f0-fc0e-4d80-81dd-ffa88ca7f928" returned: 0 in 1.337s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d.085621f0-fc0e-4d80-81dd-ffa88ca7f928 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:28 devstack sudo[97618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.info
Jul 03 13:09:28 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:28 devstack sudo[97619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d.085621f0-fc0e-4d80-81dd-ffa88ca7f928
Jul 03 13:09:28 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:29 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4ea3937a-52a0-4dad-89a3-3610ce024a5a tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.info" returned: 0 in 0.787s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:29 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-4ea3937a-52a0-4dad-89a3-3610ce024a5a tempest-VolumesDeleteCascade-510417396 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.info is being set with open permissions: ugo+rw
Jul 03 13:09:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4ea3937a-52a0-4dad-89a3-3610ce024a5a tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:29 devstack sudo[97624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.info
Jul 03 13:09:29 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:29 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d.085621f0-fc0e-4d80-81dd-ffa88ca7f928" returned: 0 in 0.894s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:29 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-085621f0-fc0e-4d80-81dd-ffa88ca7f928" released by "_delete_snapshot" :: held 4.966s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:29 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-b90b7abc-720f-45c7-8ef9-f80d488e496d" released by "delete_snapshot" :: held 4.994s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:29 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "cinder-quobyte-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:29 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:29 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "cinder-quobyte-cda51a9b-97e8-4aa5-834e-ccc3f550efab" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:29 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-cda51a9b-97e8-4aa5-834e-ccc3f550efab" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:29 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] Deleting offline snapshot cda51a9b-97e8-4aa5-834e-ccc3f550efab of volume 5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:09:29 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] snapshot_file for this snap is: volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd.cda51a9b-97e8-4aa5-834e-ccc3f550efab {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:09:29 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f003d932-a415-45aa-8b5a-473318f52bde]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd.cda51a9b-97e8-4aa5-834e-ccc3f550efab {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:29 devstack sudo[97626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd.cda51a9b-97e8-4aa5-834e-ccc3f550efab
Jul 03 13:09:29 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:30 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4ea3937a-52a0-4dad-89a3-3610ce024a5a tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.info" returned: 0 in 1.056s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4ea3937a-52a0-4dad-89a3-3610ce024a5a tempest-VolumesDeleteCascade-510417396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.578s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:30 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-4ea3937a-52a0-4dad-89a3-3610ce024a5a tempest-VolumesDeleteCascade-510417396 None] Create snapshot completed successfully
Jul 03 13:09:30 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd.cda51a9b-97e8-4aa5-834e-ccc3f550efab" returned: 0 in 1.213s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:09:30 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[921bd342-38bf-45e5-9d84-40983e4c8766]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:31 devstack sudo[97632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd
Jul 03 13:09:31 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:31 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd" returned: 0 in 1.021s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd.cda51a9b-97e8-4aa5-834e-ccc3f550efab {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:31 devstack sudo[97638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd.cda51a9b-97e8-4aa5-834e-ccc3f550efab
Jul 03 13:09:31 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Flow 'volume_create_manager' (3b23156c-ff48-4e55-a02f-8f2c40b9d8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ebec27a-9c2c-4823-9d08-0d5abe576bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ebec27a-9c2c-4823-9d08-0d5abe576bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-728076666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d107f18b9194cc7b68335c6762dd2bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dd16ff5d-9e80-4577-9145-44181cb177b4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:09:32Z,use_quota=True,user_id='1f52404ad05e4b7fbffec77f7c864024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05c8c744-7b8a-44a3-be7e-1fdea4091a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05c8c744-7b8a-44a3-be7e-1fdea4091a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3303099-341e-4a83-ba52-064b27f4bf53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3303099-341e-4a83-ba52-064b27f4bf53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988', 'volume_name': 'volume-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988', 'volume_size': 1, 'snapshot_id': 'dd16ff5d-9e80-4577-9145-44181cb177b4'}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7827d9bc-1630-433a-8d9b-71a728cba8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7827d9bc-1630-433a-8d9b-71a728cba8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba59e1cb-85f0-4ea9-ba9a-86bd0c350c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:32 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Volume f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988', 'volume_size': 1, 'snapshot_id': 'dd16ff5d-9e80-4577-9145-44181cb177b4'}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "cinder-quobyte-dd16ff5d-9e80-4577-9145-44181cb177b4-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988" by "_create_volume_from_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-quobyte-dd16ff5d-9e80-4577-9145-44181cb177b4-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Creating volume f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988 from snapshot dd16ff5d-9e80-4577-9145-44181cb177b4 {{(pid=86837) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "cinder-quobyte-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988" by "_copy_volume_from_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-quobyte-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] snapshot: dd16ff5d-9e80-4577-9145-44181cb177b4, volume: f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988,  {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a2e432-a4e3-4c57-9c56-51611fc5f37f]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.dd16ff5d-9e80-4577-9145-44181cb177b4 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:32 devstack sudo[97641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.dd16ff5d-9e80-4577-9145-44181cb177b4
Jul 03 13:09:32 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:33 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd.cda51a9b-97e8-4aa5-834e-ccc3f550efab" returned: 0 in 1.323s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd.cda51a9b-97e8-4aa5-834e-ccc3f550efab {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:33 devstack sudo[97646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd.cda51a9b-97e8-4aa5-834e-ccc3f550efab
Jul 03 13:09:33 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:33 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.dd16ff5d-9e80-4577-9145-44181cb177b4" returned: 0 in 1.176s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:33 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18b557d3-9356-4e2c-b74c-e192aa487a32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:09:33 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32 {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 13:09:33 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Creating direct copy from snapshot {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 13:09:33 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1bd06e-be89-4e89-ba02-0f840c58277b]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:34 devstack sudo[97651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32
Jul 03 13:09:34 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:34 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd.cda51a9b-97e8-4aa5-834e-ccc3f550efab" returned: 0 in 1.053s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:34 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-cda51a9b-97e8-4aa5-834e-ccc3f550efab" released by "_delete_snapshot" :: held 4.782s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:34 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd" released by "delete_snapshot" :: held 4.820s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:34 devstack cinder-volume[86837]: WARNING cinder.quota [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-635828097 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-635828097, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:09:34 devstack cinder-volume[86837]: WARNING cinder.quota [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-635828097 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-635828097, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:09:34 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] Created reservations ['909cca7b-d5e3-424e-b2fe-30fbdb92add0', '75ebea80-f3c0-42f0-b43f-3c50c891e24d', '2531cb8e-a89f-4527-9c11-f91d74880ca6', '845adc90-59be-45ad-8cba-f0c9727bddcd'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:09:34 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] Created reservations ['82342e52-a063-4a77-9647-c41a76884e99', '434eb5a0-9c31-4475-bd5f-0f4e46ca0af3', 'dfbef385-e8ad-448c-ae37-066275c09f44', 'bc6b48de-bbe6-4a82-bac0-c53cbc1db4cf'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:09:34 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-99779a4b-9048-4bc9-aa99-852a2b97749b tempest-GroupSnapshotsTest-926850929 None] group_snapshot ceda80ba-41d8-41a9-a6db-7959c3d63af3: deleted successfully
Jul 03 13:09:35 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32" returned: 0 in 1.190s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:35 devstack cinder-volume[86837]: DEBUG cinder.utils [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Path /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988 not found in is_blk_device check {{(pid=86837) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 13:09:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:35 devstack sudo[97657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988
Jul 03 13:09:35 devstack sudo[97657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:35 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-87444a06-1ec1-4d81-b421-4a078f22aa9e tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "cinder-quobyte-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:35 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-87444a06-1ec1-4d81-b421-4a078f22aa9e tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd" acquired by "delete_volume" :: waited 0.025s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:36 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9f0192-77af-4877-827a-c4545a984789]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-87444a06-1ec1-4d81-b421-4a078f22aa9e tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:36 devstack sudo[97662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd
Jul 03 13:09:36 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:38 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-87444a06-1ec1-4d81-b421-4a078f22aa9e tempest-GroupSnapshotsTest-926850929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd" returned: 0 in 2.303s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-87444a06-1ec1-4d81-b421-4a078f22aa9e tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:38 devstack sudo[97677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd
Jul 03 13:09:38 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:40 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-87444a06-1ec1-4d81-b421-4a078f22aa9e tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd" returned: 0 in 2.238s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-87444a06-1ec1-4d81-b421-4a078f22aa9e tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-5eb8a43f-8463-44ca-bff1-ff8ccd3e47bd" released by "delete_volume" :: held 4.667s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-87444a06-1ec1-4d81-b421-4a078f22aa9e tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "cinder-quobyte-b90b7abc-720f-45c7-8ef9-f80d488e496d" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-87444a06-1ec1-4d81-b421-4a078f22aa9e tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-b90b7abc-720f-45c7-8ef9-f80d488e496d" acquired by "delete_volume" :: waited 0.045s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:40 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc69c78b-435b-4c5d-b382-291406e605df]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-87444a06-1ec1-4d81-b421-4a078f22aa9e tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:41 devstack sudo[97680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d
Jul 03 13:09:41 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:41 devstack sudo[97657]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988" returned: 0 in 6.457s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:41 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95cfccc-68a1-4c19-bf8b-4cb8db76c25f]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:41 devstack sudo[97682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32
Jul 03 13:09:41 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:42 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-87444a06-1ec1-4d81-b421-4a078f22aa9e tempest-GroupSnapshotsTest-926850929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d" returned: 0 in 1.477s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-87444a06-1ec1-4d81-b421-4a078f22aa9e tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:42 devstack sudo[97690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d
Jul 03 13:09:42 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:42 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32" returned: 0 in 1.264s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:42 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32, size 1024.00 MB, duration 6.46 sec, destination /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988 {{(pid=86837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 13:09:42 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Converted 1024.00 MB image at 158.56 MB/s
Jul 03 13:09:42 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988 is being set with open permissions: ugo+rw
Jul 03 13:09:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:42 devstack sudo[97696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988
Jul 03 13:09:42 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:43 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-87444a06-1ec1-4d81-b421-4a078f22aa9e tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b90b7abc-720f-45c7-8ef9-f80d488e496d" returned: 0 in 0.891s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:43 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-87444a06-1ec1-4d81-b421-4a078f22aa9e tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-b90b7abc-720f-45c7-8ef9-f80d488e496d" released by "delete_volume" :: held 2.504s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:43 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-87444a06-1ec1-4d81-b421-4a078f22aa9e tempest-GroupSnapshotsTest-926850929 None] Created reservations ['c1347799-77fe-4df5-b8b0-9fba6f83caad'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:09:43 devstack cinder-volume[86837]: WARNING cinder.quota [None req-87444a06-1ec1-4d81-b421-4a078f22aa9e tempest-GroupSnapshotsTest-926850929 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-635828097 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-635828097, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:09:43 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-87444a06-1ec1-4d81-b421-4a078f22aa9e tempest-GroupSnapshotsTest-926850929 None] Created reservations ['87c4ce70-7737-460f-9a66-89895c5289a3', '5fb3510a-51c0-4e0a-919c-2109bbc29402', 'e3ce2058-3873-4bd5-ba4e-dd9959f8f597', '51c3768c-97a7-41a4-95c4-46eed6f0b958'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:09:43 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-87444a06-1ec1-4d81-b421-4a078f22aa9e tempest-GroupSnapshotsTest-926850929 None] Created reservations ['a49a0564-a2c8-447b-b5b3-29cdf58d1723', '2e5dfc83-27c5-46fd-a758-8f8de25fc4a5', 'e68a1167-1105-4b25-962e-570b91a19570', 'cc8faa6a-010c-42c2-9e04-be88b801699c'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:09:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-87444a06-1ec1-4d81-b421-4a078f22aa9e tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-87444a06-1ec1-4d81-b421-4a078f22aa9e tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:43 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-87444a06-1ec1-4d81-b421-4a078f22aa9e tempest-GroupSnapshotsTest-926850929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:09:43 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-87444a06-1ec1-4d81-b421-4a078f22aa9e tempest-GroupSnapshotsTest-926850929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:09:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-87444a06-1ec1-4d81-b421-4a078f22aa9e tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-87444a06-1ec1-4d81-b421-4a078f22aa9e tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:43 devstack sudo[97700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:09:43 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:43 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988" returned: 0 in 0.927s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:43 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-quobyte-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988" released by "_copy_volume_from_snapshot" :: held 11.182s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:43 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-quobyte-dd16ff5d-9e80-4577-9145-44181cb177b4-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988" released by "_create_volume_from_snapshot" :: held 11.249s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.272s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba59e1cb-85f0-4ea9-ba9a-86bd0c350c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988', 'volume_size': 1, 'snapshot_id': 'dd16ff5d-9e80-4577-9145-44181cb177b4'}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b94cfe8d-dbd6-4493-a6c7-2f55f6d2bc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:43 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Volume volume-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988 (f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988): created successfully
Jul 03 13:09:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b94cfe8d-dbd6-4493-a6c7-2f55f6d2bc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Flow 'volume_create_manager' (3b23156c-ff48-4e55-a02f-8f2c40b9d8b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:09:43 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-bb281515-de23-4d3b-a7a4-fc389734dc7b tempest-VolumesDeleteCascade-510417396 None] Created volume successfully.
Jul 03 13:09:44 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:09:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Flow 'volume_create_manager' (9f5f3d08-e11c-46a6-a8ee-3f639b97007b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:09:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01b3d85-99a4-4a00-aed9-5c5660545427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01b3d85-99a4-4a00-aed9-5c5660545427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e663f742-ed17-4441-83e8-48e1aad28f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61660d6cd8ae4034a7e9d8451c327b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:09:44Z,use_quota=True,user_id='b80ca9b1b41f4a8c8f60d1421acf6b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20f9842b-9e67-4507-a86c-06b323800bfd),volume_type_id=20f9842b-9e67-4507-a86c-06b323800bfd)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097c092b-feab-40d8-8f4e-efb7af43c045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097c092b-feab-40d8-8f4e-efb7af43c045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea55d6d9-4556-43e6-9a59-39e8dedc4860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:44 devstack cinder-volume[86837]: DEBUG cinder.image.glance [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Creating Keystone auth plugin from conf {{(pid=86837) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 13:09:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea55d6d9-4556-43e6-9a59-39e8dedc4860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e663f742-ed17-4441-83e8-48e1aad28f51', 'volume_name': 'volume-e663f742-ed17-4441-83e8-48e1aad28f51', 'volume_size': 1, 'image_id': '51f8aaaa-41e9-4ff9-b05a-6803e46cef74', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/51f8aaaa-41e9-4ff9-b05a-6803e46cef74', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fd63dea3ecff76ab8c9fc4d8da853348', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '61660d6cd8ae4034a7e9d8451c327b54', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b75c003c6996e560faa58f5ea566403531c7603ef4e6a53ba36d36e4a144e8def3365055f1a77e4bd3647ec46ea804c0cc3ba42d7f0ad1661f317c879b54b758', 'id': '51f8aaaa-41e9-4ff9-b05a-6803e46cef74', 'created_at': datetime.datetime(2026, 7, 3, 11, 9, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 9, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/51f8aaaa-41e9-4ff9-b05a-6803e46cef74/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7aa53c39cf50>}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e824aaa8-0d1e-481e-8e84-dbd4ff8a52d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e824aaa8-0d1e-481e-8e84-dbd4ff8a52d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd218277-f5e9-43e4-9d21-abdee7ee94d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:44 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Volume e663f742-ed17-4441-83e8-48e1aad28f51: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e663f742-ed17-4441-83e8-48e1aad28f51', 'volume_size': 1, 'image_id': '51f8aaaa-41e9-4ff9-b05a-6803e46cef74', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/51f8aaaa-41e9-4ff9-b05a-6803e46cef74', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fd63dea3ecff76ab8c9fc4d8da853348', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '61660d6cd8ae4034a7e9d8451c327b54', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b75c003c6996e560faa58f5ea566403531c7603ef4e6a53ba36d36e4a144e8def3365055f1a77e4bd3647ec46ea804c0cc3ba42d7f0ad1661f317c879b54b758', 'id': '51f8aaaa-41e9-4ff9-b05a-6803e46cef74', 'created_at': datetime.datetime(2026, 7, 3, 11, 9, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 9, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/51f8aaaa-41e9-4ff9-b05a-6803e46cef74/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7aa53c39cf50>}
Jul 03 13:09:44 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Trying to clone e663f742-ed17-4441-83e8-48e1aad28f51 from image 51f8aaaa-41e9-4ff9-b05a-6803e46cef74 at location (None, [{'url': 'file:///opt/stack/data/glance/images/51f8aaaa-41e9-4ff9-b05a-6803e46cef74', 'metadata': {}}]). {{(pid=86837) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 03 13:09:44 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-87444a06-1ec1-4d81-b421-4a078f22aa9e tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.014s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:44 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-87444a06-1ec1-4d81-b421-4a078f22aa9e tempest-GroupSnapshotsTest-926850929 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:09:44 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-87444a06-1ec1-4d81-b421-4a078f22aa9e tempest-GroupSnapshotsTest-926850929 None] Delete group completed successfully.
Jul 03 13:09:44 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "cinder-18b557d3-9356-4e2c-b74c-e192aa487a32-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:44 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-18b557d3-9356-4e2c-b74c-e192aa487a32-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:44 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_v82vyv8tdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86837) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 03 13:09:44 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Image download 0.00 MB at 0.00 MB/s
Jul 03 13:09:44 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-af70b9de-4d77-43cc-896c-f0ce0a416dd3 tempest-GroupSnapshotsTest-926850929 None] Group tempest-GroupSnapshotsTest-Group-1576585316: creating
Jul 03 13:09:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Performing cascade delete. {{(pid=86837) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 03 13:09:44 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "cinder-dd16ff5d-9e80-4577-9145-44181cb177b4-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:44 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8e7923-2d57-4f85-950b-aa7af8a7217d]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_v82vyv8tdevstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-dd16ff5d-9e80-4577-9145-44181cb177b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:45 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-af70b9de-4d77-43cc-896c-f0ce0a416dd3 tempest-GroupSnapshotsTest-926850929 None] Group tempest-GroupSnapshotsTest-Group-1576585316: created successfully
Jul 03 13:09:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "cinder-quobyte-18b557d3-9356-4e2c-b74c-e192aa487a32" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:45 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-af70b9de-4d77-43cc-896c-f0ce0a416dd3 tempest-GroupSnapshotsTest-926850929 None] Create group completed successfully.
Jul 03 13:09:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-quobyte-18b557d3-9356-4e2c-b74c-e192aa487a32" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "cinder-quobyte-dd16ff5d-9e80-4577-9145-44181cb177b4" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-quobyte-dd16ff5d-9e80-4577-9145-44181cb177b4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:45 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Deleting offline snapshot dd16ff5d-9e80-4577-9145-44181cb177b4 of volume 18b557d3-9356-4e2c-b74c-e192aa487a32 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:09:45 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] snapshot_file for this snap is: volume-18b557d3-9356-4e2c-b74c-e192aa487a32.dd16ff5d-9e80-4577-9145-44181cb177b4 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:09:45 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bde8fa-9b50-441d-a91c-79dc8c4f783f]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.dd16ff5d-9e80-4577-9145-44181cb177b4 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:45 devstack sudo[97704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_v82vyv8tdevstack@QuobyteHD
Jul 03 13:09:45 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:45 devstack sudo[97705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.dd16ff5d-9e80-4577-9145-44181cb177b4
Jul 03 13:09:45 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:45 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_v82vyv8tdevstack@QuobyteHD" returned: 0 in 0.864s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_v82vyv8tdevstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:45 devstack sudo[97712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_v82vyv8tdevstack@QuobyteHD
Jul 03 13:09:45 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:46 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.dd16ff5d-9e80-4577-9145-44181cb177b4" returned: 0 in 0.903s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18b557d3-9356-4e2c-b74c-e192aa487a32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d442690d-e0c9-478b-8f10-5426ca071b9d]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:46 devstack sudo[97715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32
Jul 03 13:09:46 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:UPDATE=112,cinder:SELECT=114,cinder:INSERT=28,cinder:DELETE=5 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=123,cinder:UPDATE=119,cinder:INSERT=27,cinder:DELETE=5 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:09:46 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Flow 'volume_create_manager' (3906f549-0ec4-4e2c-be25-15d0cb83312c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bdd252-b91e-4b58-b78d-da06494344eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_v82vyv8tdevstack@QuobyteHD" returned: 1 in 0.914s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_v82vyv8tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Temporary image 51f8aaaa-41e9-4ff9-b05a-6803e46cef74 is fetched for user b80ca9b1b41f4a8c8f60d1421acf6b60. {{(pid=86837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bdd252-b91e-4b58-b78d-da06494344eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-393860065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=26121bb7-c111-4061-a4a3-d6ae4d3e1e27,host='devstack@QuobyteHD#QuobyteHD',id=23ee2198-9080-469a-b7e7-628dd219359e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='619bde85acf74a0dbf92c75c3920ce29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:09:47Z,use_quota=True,user_id='01db4f9516244a859e4161f1c41ba96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74f3a924-d3ab-4c02-b22d-1383e51bcaed),volume_type_id=74f3a924-d3ab-4c02-b22d-1383e51bcaed)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e76e6b2b-7803-4640-acf1-4d84f9e8af42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e76e6b2b-7803-4640-acf1-4d84f9e8af42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2db6c66-65f6-4917-8573-4d7dd51335f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2db6c66-65f6-4917-8573-4d7dd51335f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23ee2198-9080-469a-b7e7-628dd219359e', 'volume_name': 'volume-23ee2198-9080-469a-b7e7-628dd219359e', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6857449e-08b4-4ccb-a307-bb317e894bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6857449e-08b4-4ccb-a307-bb317e894bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cfe1b39-ba5b-495f-9a86-4efcd5e9346b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:46 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Volume 23ee2198-9080-469a-b7e7-628dd219359e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23ee2198-9080-469a-b7e7-628dd219359e', 'volume_size': 1}
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=26121bb7-c111-4061-a4a3-d6ae4d3e1e27,created_at=2026-07-03T11:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-393860065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=26121bb7-c111-4061-a4a3-d6ae4d3e1e27,host='devstack@QuobyteHD#QuobyteHD',id=23ee2198-9080-469a-b7e7-628dd219359e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='619bde85acf74a0dbf92c75c3920ce29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:09:47Z,use_quota=True,user_id='01db4f9516244a859e4161f1c41ba96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74f3a924-d3ab-4c02-b22d-1383e51bcaed),volume_type_id=74f3a924-d3ab-4c02-b22d-1383e51bcaed)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Creating volume 23ee2198-9080-469a-b7e7-628dd219359e {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:09:46 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:46 devstack sudo[97720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e 1073741824
Jul 03 13:09:46 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[11de473d-291b-4cc1-8513-a10bade4da72]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_v82vyv8tdevstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:47 devstack sudo[97725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_v82vyv8tdevstack@QuobyteHD
Jul 03 13:09:47 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:47 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32" returned: 0 in 1.123s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.dd16ff5d-9e80-4577-9145-44181cb177b4 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:47 devstack sudo[97727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.dd16ff5d-9e80-4577-9145-44181cb177b4
Jul 03 13:09:47 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:48 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e 1073741824" returned: 0 in 1.277s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:48 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_v82vyv8tdevstack@QuobyteHD" returned: 0 in 1.231s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_v82vyv8tdevstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:48 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.dd16ff5d-9e80-4577-9145-44181cb177b4" returned: 0 in 1.129s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.dd16ff5d-9e80-4577-9145-44181cb177b4 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:48 devstack sudo[97739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e
Jul 03 13:09:48 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:48 devstack sudo[97741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.dd16ff5d-9e80-4577-9145-44181cb177b4
Jul 03 13:09:48 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:48 devstack sudo[97738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_v82vyv8tdevstack@QuobyteHD
Jul 03 13:09:48 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:49 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e" returned: 0 in 0.853s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] <== create_volume: return (2239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.242s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cfe1b39-ba5b-495f-9a86-4efcd5e9346b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23ee2198-9080-469a-b7e7-628dd219359e', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f9127a-bcad-4f13-ab77-68621a1b31ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:09:49 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Volume volume-23ee2198-9080-469a-b7e7-628dd219359e (23ee2198-9080-469a-b7e7-628dd219359e): created successfully
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f9127a-bcad-4f13-ab77-68621a1b31ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Flow 'volume_create_manager' (3906f549-0ec4-4e2c-be25-15d0cb83312c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:09:49 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-ed6a5d8a-bcd0-48be-aea6-e304118daf35 tempest-GroupSnapshotsTest-926850929 None] Created volume successfully.
Jul 03 13:09:49 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32.dd16ff5d-9e80-4577-9145-44181cb177b4" returned: 0 in 0.998s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-quobyte-dd16ff5d-9e80-4577-9145-44181cb177b4" released by "_delete_snapshot" :: held 4.271s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-quobyte-18b557d3-9356-4e2c-b74c-e192aa487a32" released by "delete_snapshot" :: held 4.302s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:49 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_v82vyv8tdevstack@QuobyteHD" returned: 1 in 1.270s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_v82vyv8tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e663f742-ed17-4441-83e8-48e1aad28f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61660d6cd8ae4034a7e9d8451c327b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:09:44Z,use_quota=True,user_id='b80ca9b1b41f4a8c8f60d1421acf6b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20f9842b-9e67-4507-a86c-06b323800bfd),volume_type_id=20f9842b-9e67-4507-a86c-06b323800bfd)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Creating volume e663f742-ed17-4441-83e8-48e1aad28f51 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:09:49 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Created reservations ['406af814-08ee-4e8d-98bd-6b80b349a5ba', 'c4372e9a-0bd4-4dc2-b6d3-980f0cd4926d', '67ea8717-6965-4945-95db-7cd14a2a0972', 'fef64a64-d45a-40a6-bb9a-e80d7ac0ea77'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:09:49 devstack sudo[97756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51 1073741824
Jul 03 13:09:49 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:49 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Delete snapshot completed successfully.
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-dd16ff5d-9e80-4577-9145-44181cb177b4-delete_snapshot" released by "delete_snapshot" :: held 4.640s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Snapshots deleted, issuing volume delete {{(pid=86837) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "cinder-quobyte-18b557d3-9356-4e2c-b74c-e192aa487a32" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-quobyte-18b557d3-9356-4e2c-b74c-e192aa487a32" acquired by "delete_volume" :: waited 0.023s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6b392b-fc93-41d1-9a9c-69901ba50e5d]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:49 devstack sudo[97764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32
Jul 03 13:09:49 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:50 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51 1073741824" returned: 0 in 1.011s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:50 devstack sudo[97772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51
Jul 03 13:09:50 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:50 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32" returned: 0 in 1.026s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:50 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-9176e2b1-b814-4cad-b9a1-d4cfbe0b0cec tempest-GroupSnapshotsTest-926850929 None] GroupSnapshot c46e55ec-15d5-4751-8199-814efffc23d4: creating.
Jul 03 13:09:50 devstack sudo[97777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32
Jul 03 13:09:50 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:50 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9176e2b1-b814-4cad-b9a1-d4cfbe0b0cec tempest-GroupSnapshotsTest-926850929 None] Group snapshot c46e55ec-15d5-4751-8199-814efffc23d4: creating. {{(pid=86837) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 03 13:09:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9176e2b1-b814-4cad-b9a1-d4cfbe0b0cec tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:51 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51" returned: 0 in 0.813s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:09:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.894s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9176e2b1-b814-4cad-b9a1-d4cfbe0b0cec tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.483s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-9176e2b1-b814-4cad-b9a1-d4cfbe0b0cec tempest-GroupSnapshotsTest-926850929 None] Creating offline snapshot f6bd19bf-fa99-47b3-a988-744f73784a09 of volume 23ee2198-9080-469a-b7e7-628dd219359e {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:09:51 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0fb339-7ddd-43d0-98a6-5d2d97ae47fd]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9176e2b1-b814-4cad-b9a1-d4cfbe0b0cec tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:51 devstack cinder-volume[86837]: DEBUG cinder.volume.volume_utils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Attempting download of 51f8aaaa-41e9-4ff9-b05a-6803e46cef74 ((None, [{'url': 'file:///opt/stack/data/glance/images/51f8aaaa-41e9-4ff9-b05a-6803e46cef74', 'metadata': {}}])) to volume e663f742-ed17-4441-83e8-48e1aad28f51. {{(pid=86837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 03 13:09:51 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd904c4-1a39-4d45-a9a6-8c998a86ee39]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_c_hvry3r {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:51 devstack sudo[97780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e
Jul 03 13:09:51 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:51 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-18b557d3-9356-4e2c-b74c-e192aa487a32" returned: 0 in 0.769s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:51 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-quobyte-18b557d3-9356-4e2c-b74c-e192aa487a32" released by "delete_volume" :: held 1.899s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:51 devstack sudo[97782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_c_hvry3r
Jul 03 13:09:51 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:51 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Created reservations ['c60d705f-fc92-458e-a510-1cdfe71c3e50', 'fe958b45-cd66-46dd-b270-5e7f97750b39', '6b0bbc52-8e4b-49ae-a83f-18bd3a54d8ae', 'eab32760-e3b3-4b71-8c3d-5959a6116a87'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:09:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:09:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:09:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:51 devstack sudo[97785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:09:51 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:52 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9176e2b1-b814-4cad-b9a1-d4cfbe0b0cec tempest-GroupSnapshotsTest-926850929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e" returned: 0 in 1.015s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9176e2b1-b814-4cad-b9a1-d4cfbe0b0cec tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e.f6bd19bf-fa99-47b3-a988-744f73784a09 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:52 devstack sudo[97792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e.f6bd19bf-fa99-47b3-a988-744f73784a09 1G
Jul 03 13:09:52 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:52 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_c_hvry3r" returned: 0 in 0.983s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_c_hvry3r {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:52 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.846s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:52 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:09:52 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Deleted volume successfully.
Jul 03 13:09:52 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-233a59ab-7cd6-4ad8-ba42-5d192ab3d42b tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-18b557d3-9356-4e2c-b74c-e192aa487a32-delete_volume" released by "delete_volume" :: held 7.749s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:52 devstack sudo[97795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_c_hvry3r
Jul 03 13:09:52 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:52 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-91dbf698-6b9c-4d81-a43c-2b4dff022b0c tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "cinder-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:52 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-91dbf698-6b9c-4d81-a43c-2b4dff022b0c tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:52 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-91dbf698-6b9c-4d81-a43c-2b4dff022b0c tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "cinder-quobyte-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:52 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-91dbf698-6b9c-4d81-a43c-2b4dff022b0c tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-quobyte-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988" acquired by "delete_volume" :: waited 0.034s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:53 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[de15996a-2451-4cc5-a4d0-ab1fd6fd385c]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-91dbf698-6b9c-4d81-a43c-2b4dff022b0c tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:53 devstack sudo[97800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988
Jul 03 13:09:53 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:53 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9176e2b1-b814-4cad-b9a1-d4cfbe0b0cec tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e.f6bd19bf-fa99-47b3-a988-744f73784a09 1G" returned: 0 in 0.980s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9176e2b1-b814-4cad-b9a1-d4cfbe0b0cec tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23ee2198-9080-469a-b7e7-628dd219359e -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e.f6bd19bf-fa99-47b3-a988-744f73784a09 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:53 devstack sudo[97808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23ee2198-9080-469a-b7e7-628dd219359e -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e.f6bd19bf-fa99-47b3-a988-744f73784a09
Jul 03 13:09:53 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:53 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_c_hvry3r" returned: 1 in 0.952s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_c_hvry3r' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:09:53 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e133eae-c6ac-453d-841f-aec48171c4b4]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_v82vyv8tdevstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:53 devstack sudo[97810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_v82vyv8tdevstack@QuobyteHD
Jul 03 13:09:53 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:53 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-91dbf698-6b9c-4d81-a43c-2b4dff022b0c tempest-VolumesDeleteCascade-510417396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988" returned: 0 in 0.877s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-91dbf698-6b9c-4d81-a43c-2b4dff022b0c tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:53 devstack sudo[97819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988
Jul 03 13:09:53 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:54 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9176e2b1-b814-4cad-b9a1-d4cfbe0b0cec tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23ee2198-9080-469a-b7e7-628dd219359e -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e.f6bd19bf-fa99-47b3-a988-744f73784a09" returned: 0 in 0.850s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:54 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-9176e2b1-b814-4cad-b9a1-d4cfbe0b0cec tempest-GroupSnapshotsTest-926850929 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e.f6bd19bf-fa99-47b3-a988-744f73784a09 is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 13:09:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9176e2b1-b814-4cad-b9a1-d4cfbe0b0cec tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e.f6bd19bf-fa99-47b3-a988-744f73784a09 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:54 devstack sudo[97825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e.f6bd19bf-fa99-47b3-a988-744f73784a09
Jul 03 13:09:54 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:54 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_v82vyv8tdevstack@QuobyteHD" returned: 0 in 0.974s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_v82vyv8tdevstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:54 devstack sudo[97829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_v82vyv8tdevstack@QuobyteHD
Jul 03 13:09:54 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:54 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-91dbf698-6b9c-4d81-a43c-2b4dff022b0c tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988" returned: 0 in 0.783s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:54 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-91dbf698-6b9c-4d81-a43c-2b4dff022b0c tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-quobyte-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988" released by "delete_volume" :: held 1.732s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:54 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-91dbf698-6b9c-4d81-a43c-2b4dff022b0c tempest-VolumesDeleteCascade-510417396 None] Created reservations ['91104dd8-5f01-489f-b0c1-ba5c8d39444d', 'f1b449b1-4dda-4030-8a51-e2e3bb78d93a', 'a717ca79-88b7-4122-9c56-89ff2a896872', '4a9fea8e-3a3e-4f0a-9353-6d23b3509533'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:09:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-91dbf698-6b9c-4d81-a43c-2b4dff022b0c tempest-VolumesDeleteCascade-510417396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:09:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-91dbf698-6b9c-4d81-a43c-2b4dff022b0c tempest-VolumesDeleteCascade-510417396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:09:54 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-91dbf698-6b9c-4d81-a43c-2b4dff022b0c tempest-VolumesDeleteCascade-510417396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:09:54 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-91dbf698-6b9c-4d81-a43c-2b4dff022b0c tempest-VolumesDeleteCascade-510417396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:09:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-91dbf698-6b9c-4d81-a43c-2b4dff022b0c tempest-VolumesDeleteCascade-510417396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-91dbf698-6b9c-4d81-a43c-2b4dff022b0c tempest-VolumesDeleteCascade-510417396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:54 devstack sudo[97833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:09:54 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:55 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9176e2b1-b814-4cad-b9a1-d4cfbe0b0cec tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e.f6bd19bf-fa99-47b3-a988-744f73784a09" returned: 0 in 0.780s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9176e2b1-b814-4cad-b9a1-d4cfbe0b0cec tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:55 devstack sudo[97835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e.info
Jul 03 13:09:55 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:55 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_v82vyv8tdevstack@QuobyteHD" returned: 1 in 1.057s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_v82vyv8tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:09:55 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] 51f8aaaa-41e9-4ff9-b05a-6803e46cef74 was raw, converting to raw {{(pid=86837) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 03 13:09:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_v82vyv8tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:55 devstack sudo[97859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_v82vyv8tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51
Jul 03 13:09:55 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:56 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-91dbf698-6b9c-4d81-a43c-2b4dff022b0c tempest-VolumesDeleteCascade-510417396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.716s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:56 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-91dbf698-6b9c-4d81-a43c-2b4dff022b0c tempest-VolumesDeleteCascade-510417396 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:09:56 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-91dbf698-6b9c-4d81-a43c-2b4dff022b0c tempest-VolumesDeleteCascade-510417396 None] Deleted volume successfully.
Jul 03 13:09:56 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-91dbf698-6b9c-4d81-a43c-2b4dff022b0c tempest-VolumesDeleteCascade-510417396 None] Lock "cinder-f9bf204d-5f6f-42f9-a6f6-a6beeeb2f988-delete_volume" released by "delete_volume" :: held 3.793s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:09:56 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9176e2b1-b814-4cad-b9a1-d4cfbe0b0cec tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e.info" returned: 0 in 1.635s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:56 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-9176e2b1-b814-4cad-b9a1-d4cfbe0b0cec tempest-GroupSnapshotsTest-926850929 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 13:09:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9176e2b1-b814-4cad-b9a1-d4cfbe0b0cec tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:56 devstack sudo[97907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e.info
Jul 03 13:09:56 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:57 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_v82vyv8tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51" returned: 0 in 1.583s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:57 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_51f8aaaa-41e9-4ff9-b05a-6803e46cef74_v82vyv8tdevstack@QuobyteHD, size 0.00 MB, duration 1.59 sec, destination /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51 {{(pid=86837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 13:09:57 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Converted 0.00 MB image at 0.00 MB/s
Jul 03 13:09:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:57 devstack sudo[97915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51 1G
Jul 03 13:09:57 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:57 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9176e2b1-b814-4cad-b9a1-d4cfbe0b0cec tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e.info" returned: 0 in 1.234s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9176e2b1-b814-4cad-b9a1-d4cfbe0b0cec tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.618s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:09:58 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-9176e2b1-b814-4cad-b9a1-d4cfbe0b0cec tempest-GroupSnapshotsTest-926850929 None] group_snapshot c46e55ec-15d5-4751-8199-814efffc23d4: created successfully
Jul 03 13:09:58 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root
Jul 03 13:09:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51 1G" returned: 0 in 1.521s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:09:58 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fff1ff0-6850-426d-8ad3-3610ce61cce1]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:58 devstack sudo[97923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51
Jul 03 13:09:58 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:09:58 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-948d446c-4030-44fc-8b69-6e739bf088e2 tempest-GroupSnapshotsTest-926850929 None] group_snapshot c46e55ec-15d5-4751-8199-814efffc23d4: deleting
Jul 03 13:09:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-948d446c-4030-44fc-8b69-6e739bf088e2 tempest-GroupSnapshotsTest-926850929 None] group_snapshot c46e55ec-15d5-4751-8199-814efffc23d4: deleting {{(pid=86837) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 03 13:09:59 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-948d446c-4030-44fc-8b69-6e739bf088e2 tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "cinder-quobyte-23ee2198-9080-469a-b7e7-628dd219359e" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:59 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-948d446c-4030-44fc-8b69-6e739bf088e2 tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-23ee2198-9080-469a-b7e7-628dd219359e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:59 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-948d446c-4030-44fc-8b69-6e739bf088e2 tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "cinder-quobyte-f6bd19bf-fa99-47b3-a988-744f73784a09" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:09:59 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-948d446c-4030-44fc-8b69-6e739bf088e2 tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-f6bd19bf-fa99-47b3-a988-744f73784a09" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:09:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-948d446c-4030-44fc-8b69-6e739bf088e2 tempest-GroupSnapshotsTest-926850929 None] Deleting offline snapshot f6bd19bf-fa99-47b3-a988-744f73784a09 of volume 23ee2198-9080-469a-b7e7-628dd219359e {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:09:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-948d446c-4030-44fc-8b69-6e739bf088e2 tempest-GroupSnapshotsTest-926850929 None] snapshot_file for this snap is: volume-23ee2198-9080-469a-b7e7-628dd219359e.f6bd19bf-fa99-47b3-a988-744f73784a09 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:09:59 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[7136ca28-e725-46e5-8812-19adf46f987e]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:09:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-948d446c-4030-44fc-8b69-6e739bf088e2 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e.f6bd19bf-fa99-47b3-a988-744f73784a09 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:09:59 devstack sudo[97925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e.f6bd19bf-fa99-47b3-a988-744f73784a09
Jul 03 13:09:59 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:00 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51" returned: 0 in 1.615s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:00 devstack sudo[97931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51
Jul 03 13:10:00 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:00 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-948d446c-4030-44fc-8b69-6e739bf088e2 tempest-GroupSnapshotsTest-926850929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e.f6bd19bf-fa99-47b3-a988-744f73784a09" returned: 0 in 1.334s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-948d446c-4030-44fc-8b69-6e739bf088e2 tempest-GroupSnapshotsTest-926850929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23ee2198-9080-469a-b7e7-628dd219359e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:10:00 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[398a4ded-277d-4c0f-b413-d1c952ee6c63]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-948d446c-4030-44fc-8b69-6e739bf088e2 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:00 devstack sudo[97938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e
Jul 03 13:10:00 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:02 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-948d446c-4030-44fc-8b69-6e739bf088e2 tempest-GroupSnapshotsTest-926850929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e" returned: 0 in 1.351s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:02 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-948d446c-4030-44fc-8b69-6e739bf088e2 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e.f6bd19bf-fa99-47b3-a988-744f73784a09 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51" returned: 1 in 1.719s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG cinder.volume.volume_utils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Downloaded image 51f8aaaa-41e9-4ff9-b05a-6803e46cef74 ((None, [{'url': 'file:///opt/stack/data/glance/images/51f8aaaa-41e9-4ff9-b05a-6803e46cef74', 'metadata': {}}])) to volume e663f742-ed17-4441-83e8-48e1aad28f51 successfully. {{(pid=86837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Temporary image 51f8aaaa-41e9-4ff9-b05a-6803e46cef74 for user b80ca9b1b41f4a8c8f60d1421acf6b60 is deleted. {{(pid=86837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG cinder.volume.volume_utils [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Marking volume e663f742-ed17-4441-83e8-48e1aad28f51 as bootable. {{(pid=86837) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Copying metadata from image 51f8aaaa-41e9-4ff9-b05a-6803e46cef74 to e663f742-ed17-4441-83e8-48e1aad28f51. {{(pid=86837) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Creating volume glance metadata for volume e663f742-ed17-4441-83e8-48e1aad28f51 backed by image 51f8aaaa-41e9-4ff9-b05a-6803e46cef74 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '51f8aaaa-41e9-4ff9-b05a-6803e46cef74', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'fd63dea3ecff76ab8c9fc4d8da853348', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86837) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 13:10:02 devstack sudo[97947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e.f6bd19bf-fa99-47b3-a988-744f73784a09
Jul 03 13:10:02 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd218277-f5e9-43e4-9d21-abdee7ee94d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e663f742-ed17-4441-83e8-48e1aad28f51', 'volume_size': 1, 'image_id': '51f8aaaa-41e9-4ff9-b05a-6803e46cef74', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/51f8aaaa-41e9-4ff9-b05a-6803e46cef74', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fd63dea3ecff76ab8c9fc4d8da853348', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '61660d6cd8ae4034a7e9d8451c327b54', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b75c003c6996e560faa58f5ea566403531c7603ef4e6a53ba36d36e4a144e8def3365055f1a77e4bd3647ec46ea804c0cc3ba42d7f0ad1661f317c879b54b758', 'id': '51f8aaaa-41e9-4ff9-b05a-6803e46cef74', 'created_at': datetime.datetime(2026, 7, 3, 11, 9, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 9, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/51f8aaaa-41e9-4ff9-b05a-6803e46cef74/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7aa53c39cf50>}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59987ef-873c-4418-8440-198fd8095e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:02 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Volume volume-e663f742-ed17-4441-83e8-48e1aad28f51 (e663f742-ed17-4441-83e8-48e1aad28f51): created successfully
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59987ef-873c-4418-8440-198fd8095e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Flow 'volume_create_manager' (9f5f3d08-e11c-46a6-a8ee-3f639b97007b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:02 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-f71a424a-c7f3-4a30-8ef0-1d9a40d61928 tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Created volume successfully.
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Flow 'volume_create_manager' (8747cc77-9581-490d-8df8-7e31792ee4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c0fe7c-0176-402c-ba5a-ecc3e593d771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c0fe7c-0176-402c-ba5a-ecc3e593d771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1789535734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b1753b-5745-453f-9eec-b11c1259f1dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087c89c87620428c80457fd62b5a74f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:02Z,use_quota=True,user_id='f6aa9c1107de400fae2b16f127680777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a020ead6-03e1-4e2c-9da0-01589bca107f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a020ead6-03e1-4e2c-9da0-01589bca107f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c693f02-e02d-4050-bfd0-028786ab0567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c693f02-e02d-4050-bfd0-028786ab0567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36b1753b-5745-453f-9eec-b11c1259f1dc', 'volume_name': 'volume-36b1753b-5745-453f-9eec-b11c1259f1dc', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38260b48-1888-4d74-a75d-bddd9441c065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38260b48-1888-4d74-a75d-bddd9441c065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd7e97ff-9bbf-4ea3-82e8-d9b50785f02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:02 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Volume 36b1753b-5745-453f-9eec-b11c1259f1dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36b1753b-5745-453f-9eec-b11c1259f1dc', 'volume_size': 1}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1789535734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b1753b-5745-453f-9eec-b11c1259f1dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087c89c87620428c80457fd62b5a74f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:02Z,use_quota=True,user_id='f6aa9c1107de400fae2b16f127680777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Creating volume 36b1753b-5745-453f-9eec-b11c1259f1dc {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:10:02 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:10:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-36b1753b-5745-453f-9eec-b11c1259f1dc 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:02 devstack sudo[97951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-36b1753b-5745-453f-9eec-b11c1259f1dc 1073741824
Jul 03 13:10:02 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:03 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-948d446c-4030-44fc-8b69-6e739bf088e2 tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e.f6bd19bf-fa99-47b3-a988-744f73784a09" returned: 0 in 1.192s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-948d446c-4030-44fc-8b69-6e739bf088e2 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e.f6bd19bf-fa99-47b3-a988-744f73784a09 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:03 devstack sudo[97957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e.f6bd19bf-fa99-47b3-a988-744f73784a09
Jul 03 13:10:03 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:03 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-67da4875-22c9-4861-a95c-ea97ece8f11d tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Acquiring lock "cinder-e663f742-ed17-4441-83e8-48e1aad28f51-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:03 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-67da4875-22c9-4861-a95c-ea97ece8f11d tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Lock "cinder-e663f742-ed17-4441-83e8-48e1aad28f51-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:03 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-67da4875-22c9-4861-a95c-ea97ece8f11d tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Acquiring lock "cinder-quobyte-e663f742-ed17-4441-83e8-48e1aad28f51" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:03 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-67da4875-22c9-4861-a95c-ea97ece8f11d tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Lock "cinder-quobyte-e663f742-ed17-4441-83e8-48e1aad28f51" acquired by "delete_volume" :: waited 0.050s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:03 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4006202-af81-48ef-b4c7-7e64198b1e3f]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-67da4875-22c9-4861-a95c-ea97ece8f11d tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:03 devstack sudo[97963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51
Jul 03 13:10:03 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:03 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-36b1753b-5745-453f-9eec-b11c1259f1dc 1073741824" returned: 0 in 1.339s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-36b1753b-5745-453f-9eec-b11c1259f1dc {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:04 devstack sudo[97965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-36b1753b-5745-453f-9eec-b11c1259f1dc
Jul 03 13:10:04 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:04 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-948d446c-4030-44fc-8b69-6e739bf088e2 tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e.f6bd19bf-fa99-47b3-a988-744f73784a09" returned: 0 in 1.092s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-948d446c-4030-44fc-8b69-6e739bf088e2 tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-f6bd19bf-fa99-47b3-a988-744f73784a09" released by "_delete_snapshot" :: held 5.135s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-948d446c-4030-44fc-8b69-6e739bf088e2 tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-23ee2198-9080-469a-b7e7-628dd219359e" released by "delete_snapshot" :: held 5.188s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:04 devstack cinder-volume[86837]: WARNING cinder.quota [None req-948d446c-4030-44fc-8b69-6e739bf088e2 tempest-GroupSnapshotsTest-926850929 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1682411218 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1682411218, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:10:04 devstack cinder-volume[86837]: WARNING cinder.quota [None req-948d446c-4030-44fc-8b69-6e739bf088e2 tempest-GroupSnapshotsTest-926850929 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1682411218 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1682411218, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:10:04 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-948d446c-4030-44fc-8b69-6e739bf088e2 tempest-GroupSnapshotsTest-926850929 None] Created reservations ['004e73d5-ef5d-4b2f-8ae9-ea195b63f641', '32badb38-3ed1-41cb-8f79-376502abe7a0', 'f3b92f0e-a827-45ee-99f9-53244e1de10c', '0fbef751-7999-4c43-8385-0464d20c6b2f'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:10:04 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-948d446c-4030-44fc-8b69-6e739bf088e2 tempest-GroupSnapshotsTest-926850929 None] group_snapshot c46e55ec-15d5-4751-8199-814efffc23d4: deleted successfully
Jul 03 13:10:04 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-67da4875-22c9-4861-a95c-ea97ece8f11d tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51" returned: 0 in 1.101s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-67da4875-22c9-4861-a95c-ea97ece8f11d tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:04 devstack sudo[97970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51
Jul 03 13:10:04 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:05 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-36b1753b-5745-453f-9eec-b11c1259f1dc" returned: 0 in 1.001s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:05 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] <== create_volume: return (2423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:10:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.426s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd7e97ff-9bbf-4ea3-82e8-d9b50785f02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36b1753b-5745-453f-9eec-b11c1259f1dc', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be8785b-96ec-4709-bcd2-a68345c24a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:05 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Volume volume-36b1753b-5745-453f-9eec-b11c1259f1dc (36b1753b-5745-453f-9eec-b11c1259f1dc): created successfully
Jul 03 13:10:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be8785b-96ec-4709-bcd2-a68345c24a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Flow 'volume_create_manager' (8747cc77-9581-490d-8df8-7e31792ee4df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:05 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-6a257a4d-00b9-4370-8818-2f5cf2831b5a tempest-VolumesMetadataTest-1925724229 None] Created volume successfully.
Jul 03 13:10:05 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d6177458-457d-4435-8241-b0e85c205a36 tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "cinder-quobyte-23ee2198-9080-469a-b7e7-628dd219359e" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:05 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d6177458-457d-4435-8241-b0e85c205a36 tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-23ee2198-9080-469a-b7e7-628dd219359e" acquired by "delete_volume" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:05 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40941c3-d112-482c-9bc8-67db2c4243f5]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d6177458-457d-4435-8241-b0e85c205a36 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:05 devstack sudo[97973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e
Jul 03 13:10:05 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:05 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-67da4875-22c9-4861-a95c-ea97ece8f11d tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51" returned: 1 in 1.135s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-67da4875-22c9-4861-a95c-ea97ece8f11d tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:10:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-67da4875-22c9-4861-a95c-ea97ece8f11d tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:05 devstack sudo[97978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51
Jul 03 13:10:05 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:06 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d6177458-457d-4435-8241-b0e85c205a36 tempest-GroupSnapshotsTest-926850929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e" returned: 0 in 1.059s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d6177458-457d-4435-8241-b0e85c205a36 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:06 devstack sudo[97983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e
Jul 03 13:10:06 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:06 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3eb0248c-361b-4940-941a-609b418845c6 tempest-VolumesMetadataTest-1925724229 None] Acquiring lock "cinder-36b1753b-5745-453f-9eec-b11c1259f1dc-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:06 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-67da4875-22c9-4861-a95c-ea97ece8f11d tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e663f742-ed17-4441-83e8-48e1aad28f51" returned: 0 in 0.993s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:06 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3eb0248c-361b-4940-941a-609b418845c6 tempest-VolumesMetadataTest-1925724229 None] Lock "cinder-36b1753b-5745-453f-9eec-b11c1259f1dc-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:06 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-67da4875-22c9-4861-a95c-ea97ece8f11d tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Lock "cinder-quobyte-e663f742-ed17-4441-83e8-48e1aad28f51" released by "delete_volume" :: held 3.369s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3eb0248c-361b-4940-941a-609b418845c6 tempest-VolumesMetadataTest-1925724229 None] Acquiring lock "cinder-quobyte-36b1753b-5745-453f-9eec-b11c1259f1dc" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:07 devstack cinder-volume[86837]: WARNING cinder.quota [None req-67da4875-22c9-4861-a95c-ea97ece8f11d tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:10:07 devstack cinder-volume[86837]: WARNING cinder.quota [None req-67da4875-22c9-4861-a95c-ea97ece8f11d tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:10:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3eb0248c-361b-4940-941a-609b418845c6 tempest-VolumesMetadataTest-1925724229 None] Lock "cinder-quobyte-36b1753b-5745-453f-9eec-b11c1259f1dc" acquired by "delete_volume" :: waited 0.046s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:07 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ebae32-25e2-42e6-a8c1-531a4b779ebd]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3eb0248c-361b-4940-941a-609b418845c6 tempest-VolumesMetadataTest-1925724229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-36b1753b-5745-453f-9eec-b11c1259f1dc {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:07 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-67da4875-22c9-4861-a95c-ea97ece8f11d tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Created reservations ['1c66c66b-e62c-4b25-b79d-4db45c9b43d0', '93f1311c-f844-4d93-be8b-b3289ba93a80', '481f3f18-46e7-4307-8caa-4ae391b18043', '80098acd-d694-43b4-89a2-4b46e602a450'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:10:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-67da4875-22c9-4861-a95c-ea97ece8f11d tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-67da4875-22c9-4861-a95c-ea97ece8f11d tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:07 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-67da4875-22c9-4861-a95c-ea97ece8f11d tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:07 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-67da4875-22c9-4861-a95c-ea97ece8f11d tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-67da4875-22c9-4861-a95c-ea97ece8f11d tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-67da4875-22c9-4861-a95c-ea97ece8f11d tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:07 devstack sudo[97986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-36b1753b-5745-453f-9eec-b11c1259f1dc
Jul 03 13:10:07 devstack sudo[97986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:07 devstack sudo[97987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:10:07 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:07 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d6177458-457d-4435-8241-b0e85c205a36 tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23ee2198-9080-469a-b7e7-628dd219359e" returned: 0 in 0.919s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d6177458-457d-4435-8241-b0e85c205a36 tempest-GroupSnapshotsTest-926850929 None] Lock "cinder-quobyte-23ee2198-9080-469a-b7e7-628dd219359e" released by "delete_volume" :: held 2.041s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:07 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-d6177458-457d-4435-8241-b0e85c205a36 tempest-GroupSnapshotsTest-926850929 None] Created reservations ['32e8255b-c52b-40a3-9055-8612c43be072'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:10:07 devstack cinder-volume[86837]: WARNING cinder.quota [None req-d6177458-457d-4435-8241-b0e85c205a36 tempest-GroupSnapshotsTest-926850929 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1682411218 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1682411218, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:10:07 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-d6177458-457d-4435-8241-b0e85c205a36 tempest-GroupSnapshotsTest-926850929 None] Created reservations ['b9ff95eb-9562-434d-9c46-36658d46b236', 'cd215510-4a44-4c13-9b77-741d4e41fe37', '79405880-e888-41be-bc5e-913b6da7a9f2', '0b45d4f0-6607-4aa6-b11a-ce98d02568a7'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:10:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d6177458-457d-4435-8241-b0e85c205a36 tempest-GroupSnapshotsTest-926850929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d6177458-457d-4435-8241-b0e85c205a36 tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:07 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d6177458-457d-4435-8241-b0e85c205a36 tempest-GroupSnapshotsTest-926850929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:07 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d6177458-457d-4435-8241-b0e85c205a36 tempest-GroupSnapshotsTest-926850929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d6177458-457d-4435-8241-b0e85c205a36 tempest-GroupSnapshotsTest-926850929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d6177458-457d-4435-8241-b0e85c205a36 tempest-GroupSnapshotsTest-926850929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:07 devstack sudo[97991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:10:07 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:08 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-67da4875-22c9-4861-a95c-ea97ece8f11d tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.812s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:08 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-67da4875-22c9-4861-a95c-ea97ece8f11d tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:10:08 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-67da4875-22c9-4861-a95c-ea97ece8f11d tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Deleted volume successfully.
Jul 03 13:10:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-67da4875-22c9-4861-a95c-ea97ece8f11d tempest-VolumeAndVolumeTypeFromImageTest-1023453432 None] Lock "cinder-e663f742-ed17-4441-83e8-48e1aad28f51-delete_volume" released by "delete_volume" :: held 4.819s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:08 devstack sudo[97986]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3eb0248c-361b-4940-941a-609b418845c6 tempest-VolumesMetadataTest-1925724229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-36b1753b-5745-453f-9eec-b11c1259f1dc" returned: 0 in 1.425s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3eb0248c-361b-4940-941a-609b418845c6 tempest-VolumesMetadataTest-1925724229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-36b1753b-5745-453f-9eec-b11c1259f1dc {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:08 devstack sudo[97997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-36b1753b-5745-453f-9eec-b11c1259f1dc
Jul 03 13:10:08 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:09 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d6177458-457d-4435-8241-b0e85c205a36 tempest-GroupSnapshotsTest-926850929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.357s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:09 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-d6177458-457d-4435-8241-b0e85c205a36 tempest-GroupSnapshotsTest-926850929 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:10:09 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-d6177458-457d-4435-8241-b0e85c205a36 tempest-GroupSnapshotsTest-926850929 None] Delete group completed successfully.
Jul 03 13:10:09 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3eb0248c-361b-4940-941a-609b418845c6 tempest-VolumesMetadataTest-1925724229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-36b1753b-5745-453f-9eec-b11c1259f1dc" returned: 0 in 1.099s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3eb0248c-361b-4940-941a-609b418845c6 tempest-VolumesMetadataTest-1925724229 None] Lock "cinder-quobyte-36b1753b-5745-453f-9eec-b11c1259f1dc" released by "delete_volume" :: held 2.595s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:09 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-3eb0248c-361b-4940-941a-609b418845c6 tempest-VolumesMetadataTest-1925724229 None] Created reservations ['8d315acf-aca4-4c57-806b-a7bbba367ec7', 'd454208f-722c-4fd0-8225-625c6f54a0f6', '57e78c4f-b468-4d14-81d5-1f8d828d409c', 'ad2c3eb1-daad-4416-832e-5b97b16f9e65'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:10:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3eb0248c-361b-4940-941a-609b418845c6 tempest-VolumesMetadataTest-1925724229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3eb0248c-361b-4940-941a-609b418845c6 tempest-VolumesMetadataTest-1925724229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3eb0248c-361b-4940-941a-609b418845c6 tempest-VolumesMetadataTest-1925724229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3eb0248c-361b-4940-941a-609b418845c6 tempest-VolumesMetadataTest-1925724229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3eb0248c-361b-4940-941a-609b418845c6 tempest-VolumesMetadataTest-1925724229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3eb0248c-361b-4940-941a-609b418845c6 tempest-VolumesMetadataTest-1925724229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:09 devstack sudo[98001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:10:09 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:11 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3eb0248c-361b-4940-941a-609b418845c6 tempest-VolumesMetadataTest-1925724229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.259s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:11 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-3eb0248c-361b-4940-941a-609b418845c6 tempest-VolumesMetadataTest-1925724229 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:10:11 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-3eb0248c-361b-4940-941a-609b418845c6 tempest-VolumesMetadataTest-1925724229 None] Deleted volume successfully.
Jul 03 13:10:11 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3eb0248c-361b-4940-941a-609b418845c6 tempest-VolumesMetadataTest-1925724229 None] Lock "cinder-36b1753b-5745-453f-9eec-b11c1259f1dc-delete_volume" released by "delete_volume" :: held 4.260s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:10:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:14 devstack sudo[98023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:10:14 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:15 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.744s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:15 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:10:15 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:10:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 28 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:10:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>, <Thread(tpool_thread_0, started daemon 134850092431040)>, <Thread(tpool_thread_1, started daemon 134850084021952)>, <Thread(tpool_thread_2, started daemon 134850075612864)>, <Thread(tpool_thread_3, started daemon 134850067203776)>, <Thread(tpool_thread_4, started daemon 134850058794688)>, <Thread(tpool_thread_5, started daemon 134850050385600)>, <Thread(tpool_thread_6, started daemon 134850041976512)>, <Thread(tpool_thread_7, started daemon 134850033567424)>, <Thread(tpool_thread_8, started daemon 134850025158336)>, <Thread(tpool_thread_9, started daemon 134850016749248)>, <Thread(tpool_thread_10, started daemon 134850008340160)>, <Thread(tpool_thread_11, started daemon 134849999931072)>, <Thread(tpool_thread_12, started daemon 134849991521984)>, <Thread(tpool_thread_13, started daemon 134849983112896)>, <Thread(tpool_thread_14, started daemon 134849974703808)>, <Thread(tpool_thread_15, started daemon 134849966294720)>, <Thread(tpool_thread_16, started daemon 134849957885632)>, <Thread(tpool_thread_17, started daemon 134849949476544)>, <Thread(tpool_thread_18, started daemon 134849941067456)>, <Thread(tpool_thread_19, started daemon 134849932658368)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:10:17 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-a9303e9a-69b7-48b6-b5a2-0117c55d7b89 tempest-GroupsTest-1202386914 None] Group tempest-Group1-550004459: creating
Jul 03 13:10:17 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-a9303e9a-69b7-48b6-b5a2-0117c55d7b89 tempest-GroupsTest-1202386914 None] Group tempest-Group1-550004459: created successfully
Jul 03 13:10:17 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-a9303e9a-69b7-48b6-b5a2-0117c55d7b89 tempest-GroupsTest-1202386914 None] Create group completed successfully.
Jul 03 13:10:18 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:10:18 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Flow 'volume_create_manager' (040347e9-f305-4485-93d9-fb7b1611925a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:18 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c9a71b-aad0-44f9-8be0-67d2bcb4191b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:18 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c9a71b-aad0-44f9-8be0-67d2bcb4191b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1495044148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d47b1c7-0122-4ecc-9038-9262a1bee98e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83bda4ba118940c3b78d426367ddb0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:18Z,use_quota=True,user_id='c4cdcd84626d45c4ac7842eeafb0a7b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:18 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f82414c1-4d4a-47be-b2a2-79838344c419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:18 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f82414c1-4d4a-47be-b2a2-79838344c419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:18 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23a49625-80bd-40ac-ab97-788c7fe7e227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:18 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23a49625-80bd-40ac-ab97-788c7fe7e227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d47b1c7-0122-4ecc-9038-9262a1bee98e', 'volume_name': 'volume-7d47b1c7-0122-4ecc-9038-9262a1bee98e', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:18 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (720f72aa-1c12-4941-a8f2-9ae20fc9f137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:18 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (720f72aa-1c12-4941-a8f2-9ae20fc9f137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:18 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cca679a-8348-4776-9f36-e5283541b4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:18 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Volume 7d47b1c7-0122-4ecc-9038-9262a1bee98e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d47b1c7-0122-4ecc-9038-9262a1bee98e', 'volume_size': 1}
Jul 03 13:10:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:18 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1495044148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d47b1c7-0122-4ecc-9038-9262a1bee98e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83bda4ba118940c3b78d426367ddb0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:18Z,use_quota=True,user_id='c4cdcd84626d45c4ac7842eeafb0a7b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:10:18 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Creating volume 7d47b1c7-0122-4ecc-9038-9262a1bee98e {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:10:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:18 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:18 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:18 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:10:18 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:10:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d47b1c7-0122-4ecc-9038-9262a1bee98e 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:18 devstack sudo[98062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d47b1c7-0122-4ecc-9038-9262a1bee98e 1073741824
Jul 03 13:10:18 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:18 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-c42afce5-7989-41fe-aed6-2ad283d4d7ce tempest-GroupsTest-1202386914 None] Group tempest-Group2-1299479939: creating
Jul 03 13:10:18 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-c42afce5-7989-41fe-aed6-2ad283d4d7ce tempest-GroupsTest-1202386914 None] Group tempest-Group2-1299479939: created successfully
Jul 03 13:10:18 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-c42afce5-7989-41fe-aed6-2ad283d4d7ce tempest-GroupsTest-1202386914 None] Create group completed successfully.
Jul 03 13:10:19 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:10:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Flow 'volume_create_manager' (f75fc582-6b19-4000-bb48-4a8d79ee52ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c64ec76-6f86-4406-bc4b-ca91a1231e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c64ec76-6f86-4406-bc4b-ca91a1231e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdf1507d-68e3-4055-9bab-e7118e7fc3bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8320171bf11c47fea4b1749a1ab45e8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:19Z,use_quota=True,user_id='3b7d76bd4cd0499db29ec97526daf1e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bcb3774-4c6f-43b8-ba22-daea8bfdf9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bcb3774-4c6f-43b8-ba22-daea8bfdf9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0099f5e2-8053-49b7-8845-6957ab620e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:19 devstack cinder-volume[86837]: DEBUG cinder.image.glance [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Creating Keystone auth plugin from conf {{(pid=86837) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 13:10:19 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d47b1c7-0122-4ecc-9038-9262a1bee98e 1073741824" returned: 0 in 1.223s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d47b1c7-0122-4ecc-9038-9262a1bee98e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:19 devstack sudo[98068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d47b1c7-0122-4ecc-9038-9262a1bee98e
Jul 03 13:10:19 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0099f5e2-8053-49b7-8845-6957ab620e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bdf1507d-68e3-4055-9bab-e7118e7fc3bf', 'volume_name': 'volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf', 'volume_size': 1, 'image_id': 'f0faf5f7-c25d-4c9f-b059-dea2e65b32a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f0faf5f7-c25d-4c9f-b059-dea2e65b32a5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a196fc42425eb7138c512eb5fb97b081', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8320171bf11c47fea4b1749a1ab45e8e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f669a747363d5fd02789ae9b4eaf19e98f8a3f9775d56b2dd6fe3162227ca133042960840efdb784db5784cbb508ac99abcd64adf8aa2d5f92f9a8456c813cab', 'id': 'f0faf5f7-c25d-4c9f-b059-dea2e65b32a5', 'created_at': datetime.datetime(2026, 7, 3, 11, 10, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 10, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f0faf5f7-c25d-4c9f-b059-dea2e65b32a5/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7aa53bfdfc80>}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e83a6a-0216-41c7-9189-18311c14078c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e83a6a-0216-41c7-9189-18311c14078c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5051507-7c33-4d30-841b-acaca31aefd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:19 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Volume bdf1507d-68e3-4055-9bab-e7118e7fc3bf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf', 'volume_size': 1, 'image_id': 'f0faf5f7-c25d-4c9f-b059-dea2e65b32a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f0faf5f7-c25d-4c9f-b059-dea2e65b32a5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a196fc42425eb7138c512eb5fb97b081', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8320171bf11c47fea4b1749a1ab45e8e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f669a747363d5fd02789ae9b4eaf19e98f8a3f9775d56b2dd6fe3162227ca133042960840efdb784db5784cbb508ac99abcd64adf8aa2d5f92f9a8456c813cab', 'id': 'f0faf5f7-c25d-4c9f-b059-dea2e65b32a5', 'created_at': datetime.datetime(2026, 7, 3, 11, 10, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 10, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f0faf5f7-c25d-4c9f-b059-dea2e65b32a5/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7aa53bfdfc80>}
Jul 03 13:10:19 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Trying to clone bdf1507d-68e3-4055-9bab-e7118e7fc3bf from image f0faf5f7-c25d-4c9f-b059-dea2e65b32a5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f0faf5f7-c25d-4c9f-b059-dea2e65b32a5', 'metadata': {}}]). {{(pid=86837) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 03 13:10:19 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_9u3nh603devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86837) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 03 13:10:19 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Image download 0.00 MB at 0.00 MB/s
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[40599f9a-b884-490f-81ec-0170427d07ca]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_9u3nh603devstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:20 devstack sudo[98070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_9u3nh603devstack@QuobyteHD
Jul 03 13:10:20 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Flow 'volume_create_manager' (1f0b97eb-a060-4f6d-bd3b-6997e9785762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03147592-3fb9-4567-ad0e-dcf869e9f3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03147592-3fb9-4567-ad0e-dcf869e9f3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1536984182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f991c5ae-d538-4018-8713-c47bcaa63848,host='devstack@QuobyteHD#QuobyteHD',id=7643c618-5d0d-4055-8f10-d93628590ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be73edd5362418cb1f86404924ac2f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:20Z,use_quota=True,user_id='dba3dfb5e0b24b24a686a6be4711507f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(924e6873-4ff7-453f-8cb0-9b40649e0822),volume_type_id=924e6873-4ff7-453f-8cb0-9b40649e0822)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42932b13-6d5a-45e7-91d4-4616662b23e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42932b13-6d5a-45e7-91d4-4616662b23e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b46d8861-0fbb-461a-8bc8-1faf865a37ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b46d8861-0fbb-461a-8bc8-1faf865a37ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7643c618-5d0d-4055-8f10-d93628590ff7', 'volume_name': 'volume-7643c618-5d0d-4055-8f10-d93628590ff7', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:20 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e139e7b4-097a-4240-81a5-9468e8b57c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e139e7b4-097a-4240-81a5-9468e8b57c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10e48cdd-feae-4571-b0b6-141c2c996644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:20 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Volume 7643c618-5d0d-4055-8f10-d93628590ff7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7643c618-5d0d-4055-8f10-d93628590ff7', 'volume_size': 1}
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d47b1c7-0122-4ecc-9038-9262a1bee98e" returned: 0 in 1.016s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] <== create_volume: return (2299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.302s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f991c5ae-d538-4018-8713-c47bcaa63848,created_at=2026-07-03T11:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1536984182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f991c5ae-d538-4018-8713-c47bcaa63848,host='devstack@QuobyteHD#QuobyteHD',id=7643c618-5d0d-4055-8f10-d93628590ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be73edd5362418cb1f86404924ac2f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:20Z,use_quota=True,user_id='dba3dfb5e0b24b24a686a6be4711507f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(924e6873-4ff7-453f-8cb0-9b40649e0822),volume_type_id=924e6873-4ff7-453f-8cb0-9b40649e0822)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Creating volume 7643c618-5d0d-4055-8f10-d93628590ff7 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:10:20 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7643c618-5d0d-4055-8f10-d93628590ff7 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:20 devstack sudo[98073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7643c618-5d0d-4055-8f10-d93628590ff7 1073741824
Jul 03 13:10:20 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cca679a-8348-4776-9f36-e5283541b4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d47b1c7-0122-4ecc-9038-9262a1bee98e', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0110e92-6d43-40c0-9649-eb23815392db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:20 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Volume volume-7d47b1c7-0122-4ecc-9038-9262a1bee98e (7d47b1c7-0122-4ecc-9038-9262a1bee98e): created successfully
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0110e92-6d43-40c0-9649-eb23815392db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Flow 'volume_create_manager' (040347e9-f305-4485-93d9-fb7b1611925a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:20 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-4e9d5f72-ad60-4612-99e5-8ffdeb807d16 tempest-VolumesTransfersTest-456345982 None] Created volume successfully.
Jul 03 13:10:20 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_9u3nh603devstack@QuobyteHD" returned: 0 in 0.908s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_9u3nh603devstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:21 devstack sudo[98077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_9u3nh603devstack@QuobyteHD
Jul 03 13:10:21 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:21 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7643c618-5d0d-4055-8f10-d93628590ff7 1073741824" returned: 0 in 0.918s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7643c618-5d0d-4055-8f10-d93628590ff7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:21 devstack sudo[98082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7643c618-5d0d-4055-8f10-d93628590ff7
Jul 03 13:10:21 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:21 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_9u3nh603devstack@QuobyteHD" returned: 1 in 0.832s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_9u3nh603devstack@QuobyteHD' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:10:21 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Temporary image f0faf5f7-c25d-4c9f-b059-dea2e65b32a5 is fetched for user 3b7d76bd4cd0499db29ec97526daf1e8. {{(pid=86837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 03 13:10:21 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6a21a3-3f8b-41f3-b606-d59d5eb3526b]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_9u3nh603devstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:22 devstack sudo[98087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_9u3nh603devstack@QuobyteHD
Jul 03 13:10:22 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:22 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-c8275ef4-e856-46ec-87fe-8508fc42ec76 tempest-VolumesTransfersTest-667970529 None] Transfer volume completed successfully.
Jul 03 13:10:22 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7643c618-5d0d-4055-8f10-d93628590ff7" returned: 0 in 0.755s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:22 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:10:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10e48cdd-feae-4571-b0b6-141c2c996644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7643c618-5d0d-4055-8f10-d93628590ff7', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c082a4a-e952-4f8a-9c61-6e222e50dcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:22 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Volume volume-7643c618-5d0d-4055-8f10-d93628590ff7 (7643c618-5d0d-4055-8f10-d93628590ff7): created successfully
Jul 03 13:10:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c082a4a-e952-4f8a-9c61-6e222e50dcf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Flow 'volume_create_manager' (1f0b97eb-a060-4f6d-bd3b-6997e9785762) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:22 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-8649b8fc-afbb-463e-a1fb-b0d5c44bf075 tempest-GroupsTest-1202386914 None] Created volume successfully.
Jul 03 13:10:22 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_9u3nh603devstack@QuobyteHD" returned: 0 in 0.761s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_9u3nh603devstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:22 devstack sudo[98101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_9u3nh603devstack@QuobyteHD
Jul 03 13:10:22 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Flow 'volume_create_manager' (c0a6a40e-c3d5-4016-bccd-5894d4560fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be11d63-7a18-48d5-8c12-8a13c3a69573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be11d63-7a18-48d5-8c12-8a13c3a69573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-681288216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b1af832-4df9-4257-8782-f81764370c12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a53b8c83c4342578010aeced7d6db52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:23Z,use_quota=True,user_id='20c01da34cf44404bed466cb2b241407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d30a88-f596-492d-8432-92e56b402d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d30a88-f596-492d-8432-92e56b402d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62dfaa4-15bf-4409-a610-a95795442c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62dfaa4-15bf-4409-a610-a95795442c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b1af832-4df9-4257-8782-f81764370c12', 'volume_name': 'volume-4b1af832-4df9-4257-8782-f81764370c12', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b53e751e-2680-47fe-9402-8fdc32ff8024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b53e751e-2680-47fe-9402-8fdc32ff8024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b58657-b8a0-4e51-baa3-d979efdaeeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:23 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Volume 4b1af832-4df9-4257-8782-f81764370c12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b1af832-4df9-4257-8782-f81764370c12', 'volume_size': 1}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-681288216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b1af832-4df9-4257-8782-f81764370c12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a53b8c83c4342578010aeced7d6db52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:23Z,use_quota=True,user_id='20c01da34cf44404bed466cb2b241407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Creating volume 4b1af832-4df9-4257-8782-f81764370c12 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:10:23 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4b1af832-4df9-4257-8782-f81764370c12 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:23 devstack sudo[98103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4b1af832-4df9-4257-8782-f81764370c12 1073741824
Jul 03 13:10:23 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d4dae0e6-53b9-4aab-ab19-15d535be3c03 tempest-VolumesTransfersTest-105076284 None] Acquiring lock "cinder-7d47b1c7-0122-4ecc-9038-9262a1bee98e-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d4dae0e6-53b9-4aab-ab19-15d535be3c03 tempest-VolumesTransfersTest-105076284 None] Lock "cinder-7d47b1c7-0122-4ecc-9038-9262a1bee98e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d4dae0e6-53b9-4aab-ab19-15d535be3c03 tempest-VolumesTransfersTest-105076284 None] Acquiring lock "cinder-quobyte-7d47b1c7-0122-4ecc-9038-9262a1bee98e" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d4dae0e6-53b9-4aab-ab19-15d535be3c03 tempest-VolumesTransfersTest-105076284 None] Lock "cinder-quobyte-7d47b1c7-0122-4ecc-9038-9262a1bee98e" acquired by "delete_volume" :: waited 0.038s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[da449a71-288a-4a74-ad66-c07ac682f854]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d4dae0e6-53b9-4aab-ab19-15d535be3c03 tempest-VolumesTransfersTest-105076284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d47b1c7-0122-4ecc-9038-9262a1bee98e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:23 devstack sudo[98105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d47b1c7-0122-4ecc-9038-9262a1bee98e
Jul 03 13:10:23 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:23 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_9u3nh603devstack@QuobyteHD" returned: 1 in 0.978s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_9u3nh603devstack@QuobyteHD' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c5f1a55c-b3b6-4b73-b80d-04f08b1aec2e tempest-GroupsTest-1202386914 None] Acquiring lock "cinder-quobyte-7643c618-5d0d-4055-8f10-d93628590ff7" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c5f1a55c-b3b6-4b73-b80d-04f08b1aec2e tempest-GroupsTest-1202386914 None] Lock "cinder-quobyte-7643c618-5d0d-4055-8f10-d93628590ff7" acquired by "delete_volume" :: waited 0.017s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20eb045-a775-4146-8dc1-8cfb7f6f1f70]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c5f1a55c-b3b6-4b73-b80d-04f08b1aec2e tempest-GroupsTest-1202386914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7643c618-5d0d-4055-8f10-d93628590ff7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:23 devstack sudo[98110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7643c618-5d0d-4055-8f10-d93628590ff7
Jul 03 13:10:23 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:24 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4b1af832-4df9-4257-8782-f81764370c12 1073741824" returned: 0 in 1.021s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4b1af832-4df9-4257-8782-f81764370c12 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:24 devstack sudo[98119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4b1af832-4df9-4257-8782-f81764370c12
Jul 03 13:10:24 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:24 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d4dae0e6-53b9-4aab-ab19-15d535be3c03 tempest-VolumesTransfersTest-105076284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d47b1c7-0122-4ecc-9038-9262a1bee98e" returned: 0 in 0.846s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d4dae0e6-53b9-4aab-ab19-15d535be3c03 tempest-VolumesTransfersTest-105076284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d47b1c7-0122-4ecc-9038-9262a1bee98e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:24 devstack sudo[98121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d47b1c7-0122-4ecc-9038-9262a1bee98e
Jul 03 13:10:24 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:24 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c5f1a55c-b3b6-4b73-b80d-04f08b1aec2e tempest-GroupsTest-1202386914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7643c618-5d0d-4055-8f10-d93628590ff7" returned: 0 in 0.864s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c5f1a55c-b3b6-4b73-b80d-04f08b1aec2e tempest-GroupsTest-1202386914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7643c618-5d0d-4055-8f10-d93628590ff7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:24 devstack sudo[98126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7643c618-5d0d-4055-8f10-d93628590ff7
Jul 03 13:10:24 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:24 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4b1af832-4df9-4257-8782-f81764370c12" returned: 0 in 0.717s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:10:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.323s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdf1507d-68e3-4055-9bab-e7118e7fc3bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8320171bf11c47fea4b1749a1ab45e8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:19Z,use_quota=True,user_id='3b7d76bd4cd0499db29ec97526daf1e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:10:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Creating volume bdf1507d-68e3-4055-9bab-e7118e7fc3bf {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:10:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:10:25 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:10:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:25 devstack sudo[98130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf 1073741824
Jul 03 13:10:25 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b58657-b8a0-4e51-baa3-d979efdaeeef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b1af832-4df9-4257-8782-f81764370c12', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64bc318a-edc3-4fbc-b5c5-df4b891326ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:25 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Volume volume-4b1af832-4df9-4257-8782-f81764370c12 (4b1af832-4df9-4257-8782-f81764370c12): created successfully
Jul 03 13:10:25 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64bc318a-edc3-4fbc-b5c5-df4b891326ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Flow 'volume_create_manager' (c0a6a40e-c3d5-4016-bccd-5894d4560fe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d4dae0e6-53b9-4aab-ab19-15d535be3c03 tempest-VolumesTransfersTest-105076284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d47b1c7-0122-4ecc-9038-9262a1bee98e" returned: 0 in 0.722s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d4dae0e6-53b9-4aab-ab19-15d535be3c03 tempest-VolumesTransfersTest-105076284 None] Lock "cinder-quobyte-7d47b1c7-0122-4ecc-9038-9262a1bee98e" released by "delete_volume" :: held 1.633s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:25 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-d3130f67-e585-4271-871d-38c99abf1187 tempest-AttachVolumeTestJSON-933021987 None] Created volume successfully.
Jul 03 13:10:25 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-d4dae0e6-53b9-4aab-ab19-15d535be3c03 tempest-VolumesTransfersTest-105076284 None] Created reservations ['cfd4491e-cebf-4229-b4c4-0187d063df77', '355e1602-725c-4625-837c-ba3e7fb7e6e5', 'baa06823-dcef-43ab-91e7-ae00a2023824', '83f50a4c-f44f-471c-a63d-d5a070634ba1'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:10:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d4dae0e6-53b9-4aab-ab19-15d535be3c03 tempest-VolumesTransfersTest-105076284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d4dae0e6-53b9-4aab-ab19-15d535be3c03 tempest-VolumesTransfersTest-105076284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d4dae0e6-53b9-4aab-ab19-15d535be3c03 tempest-VolumesTransfersTest-105076284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d4dae0e6-53b9-4aab-ab19-15d535be3c03 tempest-VolumesTransfersTest-105076284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d4dae0e6-53b9-4aab-ab19-15d535be3c03 tempest-VolumesTransfersTest-105076284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d4dae0e6-53b9-4aab-ab19-15d535be3c03 tempest-VolumesTransfersTest-105076284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:25 devstack sudo[98133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:10:25 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:25 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c5f1a55c-b3b6-4b73-b80d-04f08b1aec2e tempest-GroupsTest-1202386914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7643c618-5d0d-4055-8f10-d93628590ff7" returned: 0 in 0.740s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c5f1a55c-b3b6-4b73-b80d-04f08b1aec2e tempest-GroupsTest-1202386914 None] Lock "cinder-quobyte-7643c618-5d0d-4055-8f10-d93628590ff7" released by "delete_volume" :: held 1.653s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:25 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-c5f1a55c-b3b6-4b73-b80d-04f08b1aec2e tempest-GroupsTest-1202386914 None] Created reservations ['370c7234-166d-4671-91ba-102d9c52e4b5'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:10:25 devstack cinder-volume[86837]: WARNING cinder.quota [None req-c5f1a55c-b3b6-4b73-b80d-04f08b1aec2e tempest-GroupsTest-1202386914 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-413928718 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-413928718, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:10:25 devstack cinder-volume[86837]: WARNING cinder.quota [None req-c5f1a55c-b3b6-4b73-b80d-04f08b1aec2e tempest-GroupsTest-1202386914 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-413928718 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-413928718, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:10:25 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-c5f1a55c-b3b6-4b73-b80d-04f08b1aec2e tempest-GroupsTest-1202386914 None] Created reservations ['4b43a1e9-4645-4e57-b1f1-2625c49583d4', 'ec7bcef6-1633-4acc-80be-fa78a8a260f2', 'd03585b1-d4e8-461d-a4b9-6bb35c6f2282', 'e01f34a6-0bcf-4af7-9bb5-e95775a34857'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:10:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c5f1a55c-b3b6-4b73-b80d-04f08b1aec2e tempest-GroupsTest-1202386914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c5f1a55c-b3b6-4b73-b80d-04f08b1aec2e tempest-GroupsTest-1202386914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c5f1a55c-b3b6-4b73-b80d-04f08b1aec2e tempest-GroupsTest-1202386914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c5f1a55c-b3b6-4b73-b80d-04f08b1aec2e tempest-GroupsTest-1202386914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c5f1a55c-b3b6-4b73-b80d-04f08b1aec2e tempest-GroupsTest-1202386914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c5f1a55c-b3b6-4b73-b80d-04f08b1aec2e tempest-GroupsTest-1202386914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:25 devstack sudo[98138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:10:25 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:26 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d4dae0e6-53b9-4aab-ab19-15d535be3c03 tempest-VolumesTransfersTest-105076284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.902s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:26 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-d4dae0e6-53b9-4aab-ab19-15d535be3c03 tempest-VolumesTransfersTest-105076284 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:10:26 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-d4dae0e6-53b9-4aab-ab19-15d535be3c03 tempest-VolumesTransfersTest-105076284 None] Deleted volume successfully.
Jul 03 13:10:26 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d4dae0e6-53b9-4aab-ab19-15d535be3c03 tempest-VolumesTransfersTest-105076284 None] Lock "cinder-7d47b1c7-0122-4ecc-9038-9262a1bee98e-delete_volume" released by "delete_volume" :: held 2.845s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:26 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf 1073741824" returned: 0 in 1.248s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:26 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:10:26 devstack sudo[98146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf
Jul 03 13:10:26 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Flow 'volume_create_manager' (d8aa2c3e-f0c1-4ea7-9659-d5009786b842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (110007f9-2335-4a25-891e-add66d7b1834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (110007f9-2335-4a25-891e-add66d7b1834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-880157929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f684534-3e60-49ff-8751-3f67a41f7416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83bda4ba118940c3b78d426367ddb0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:26Z,use_quota=True,user_id='c4cdcd84626d45c4ac7842eeafb0a7b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04187f0e-a449-47e9-b759-f138f48e2353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04187f0e-a449-47e9-b759-f138f48e2353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c68956f9-551d-4bbf-afb8-3cae209b468c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c68956f9-551d-4bbf-afb8-3cae209b468c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f684534-3e60-49ff-8751-3f67a41f7416', 'volume_name': 'volume-7f684534-3e60-49ff-8751-3f67a41f7416', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6843e7-980d-4ec9-9f7e-b8e6e1ff4de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6843e7-980d-4ec9-9f7e-b8e6e1ff4de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6602176-39f3-4257-b8ce-30cfc0e21e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:26 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Volume 7f684534-3e60-49ff-8751-3f67a41f7416: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f684534-3e60-49ff-8751-3f67a41f7416', 'volume_size': 1}
Jul 03 13:10:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:26 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-f1939e4f-d5d3-4c7a-817f-4a9b851fa751 tempest-GroupsTest-1202386914 None] Created reservations ['3731f95e-39f2-4aae-9234-1e1e21dc503c'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:10:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f1939e4f-d5d3-4c7a-817f-4a9b851fa751 tempest-GroupsTest-1202386914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f1939e4f-d5d3-4c7a-817f-4a9b851fa751 tempest-GroupsTest-1202386914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f1939e4f-d5d3-4c7a-817f-4a9b851fa751 tempest-GroupsTest-1202386914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f1939e4f-d5d3-4c7a-817f-4a9b851fa751 tempest-GroupsTest-1202386914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f1939e4f-d5d3-4c7a-817f-4a9b851fa751 tempest-GroupsTest-1202386914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f1939e4f-d5d3-4c7a-817f-4a9b851fa751 tempest-GroupsTest-1202386914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:26 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c5f1a55c-b3b6-4b73-b80d-04f08b1aec2e tempest-GroupsTest-1202386914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.881s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:26 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-c5f1a55c-b3b6-4b73-b80d-04f08b1aec2e tempest-GroupsTest-1202386914 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:10:26 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-c5f1a55c-b3b6-4b73-b80d-04f08b1aec2e tempest-GroupsTest-1202386914 None] Delete group completed successfully.
Jul 03 13:10:26 devstack sudo[98149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:10:26 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:27 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf" returned: 0 in 0.748s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:27 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] <== create_volume: return (2136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:10:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.140s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.636s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:27 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-880157929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f684534-3e60-49ff-8751-3f67a41f7416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83bda4ba118940c3b78d426367ddb0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:26Z,use_quota=True,user_id='c4cdcd84626d45c4ac7842eeafb0a7b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:10:27 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Creating volume 7f684534-3e60-49ff-8751-3f67a41f7416 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:10:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:27 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:27 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:27 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:10:27 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:10:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7f684534-3e60-49ff-8751-3f67a41f7416 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:27 devstack sudo[98152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7f684534-3e60-49ff-8751-3f67a41f7416 1073741824
Jul 03 13:10:27 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:27 devstack cinder-volume[86837]: DEBUG cinder.volume.volume_utils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Attempting download of f0faf5f7-c25d-4c9f-b059-dea2e65b32a5 ((None, [{'url': 'file:///opt/stack/data/glance/images/f0faf5f7-c25d-4c9f-b059-dea2e65b32a5', 'metadata': {}}])) to volume bdf1507d-68e3-4055-9bab-e7118e7fc3bf. {{(pid=86837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 03 13:10:27 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4cc37f-4a40-43fd-8ba2-875c10586b80]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_99991dy9 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:27 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f1939e4f-d5d3-4c7a-817f-4a9b851fa751 tempest-GroupsTest-1202386914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.757s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:27 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f1939e4f-d5d3-4c7a-817f-4a9b851fa751 tempest-GroupsTest-1202386914 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:10:27 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-f1939e4f-d5d3-4c7a-817f-4a9b851fa751 tempest-GroupsTest-1202386914 None] Delete group completed successfully.
Jul 03 13:10:27 devstack sudo[98155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_99991dy9
Jul 03 13:10:27 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:28 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-fb8fb8ac-85be-4524-92d5-c9af3f483ec5 tempest-GroupsTest-1202386914 None] Group tempest-GroupsTest-Group-377085369: creating
Jul 03 13:10:28 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-fb8fb8ac-85be-4524-92d5-c9af3f483ec5 tempest-GroupsTest-1202386914 None] Group tempest-GroupsTest-Group-377085369: created successfully
Jul 03 13:10:28 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-fb8fb8ac-85be-4524-92d5-c9af3f483ec5 tempest-GroupsTest-1202386914 None] Create group completed successfully.
Jul 03 13:10:28 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_99991dy9" returned: 0 in 0.873s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_99991dy9 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:28 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7f684534-3e60-49ff-8751-3f67a41f7416 1073741824" returned: 0 in 1.065s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7f684534-3e60-49ff-8751-3f67a41f7416 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:28 devstack sudo[98163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_99991dy9
Jul 03 13:10:28 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:28 devstack sudo[98171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7f684534-3e60-49ff-8751-3f67a41f7416
Jul 03 13:10:28 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-1f616bc0-cbc3-407f-b01f-876989356a30 req-ca529793-5a16-4a86-923c-779b4c25452b tempest-AttachVolumeTestJSON-933021987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:28 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_99991dy9" returned: 1 in 0.760s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_99991dy9' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:10:28 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb40ea7-6b42-448d-a956-0a634704e004]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_9u3nh603devstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:28 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7f684534-3e60-49ff-8751-3f67a41f7416" returned: 0 in 0.675s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:28 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:10:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-1f616bc0-cbc3-407f-b01f-876989356a30 req-ca529793-5a16-4a86-923c-779b4c25452b tempest-AttachVolumeTestJSON-933021987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.534s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:28 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6602176-39f3-4257-b8ce-30cfc0e21e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f684534-3e60-49ff-8751-3f67a41f7416', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:28 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999a5dc4-997c-462f-b7ea-e05f0869b9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:28 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b909b2-68be-4d89-8071-00bffe136bfe]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-1f616bc0-cbc3-407f-b01f-876989356a30 req-ca529793-5a16-4a86-923c-779b4c25452b tempest-AttachVolumeTestJSON-933021987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4b1af832-4df9-4257-8782-f81764370c12 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:29 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Volume volume-7f684534-3e60-49ff-8751-3f67a41f7416 (7f684534-3e60-49ff-8751-3f67a41f7416): created successfully
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999a5dc4-997c-462f-b7ea-e05f0869b9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Flow 'volume_create_manager' (d8aa2c3e-f0c1-4ea7-9659-d5009786b842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:29 devstack sudo[98178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_9u3nh603devstack@QuobyteHD
Jul 03 13:10:29 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:29 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-0e8bdfe9-1103-46e9-9f26-e2031977b23c tempest-VolumesTransfersTest-456345982 None] Created volume successfully.
Jul 03 13:10:29 devstack sudo[98179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4b1af832-4df9-4257-8782-f81764370c12
Jul 03 13:10:29 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Flow 'volume_create_manager' (7f922097-84a4-4908-a4f6-62e56f9dc4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:29 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d557d6e7-778c-47d4-a035-caca9fe4c45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_9u3nh603devstack@QuobyteHD" returned: 0 in 0.871s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_9u3nh603devstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d557d6e7-778c-47d4-a035-caca9fe4c45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-71160517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9eb88439-439b-471e-b709-86010e012cff,host='devstack@QuobyteHD#QuobyteHD',id=1b5997d1-d9ff-425a-afa0-ccb3bc8eef3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be73edd5362418cb1f86404924ac2f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:30Z,use_quota=True,user_id='dba3dfb5e0b24b24a686a6be4711507f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff66d518-1c86-471b-b9ba-3b80983210f4),volume_type_id=ff66d518-1c86-471b-b9ba-3b80983210f4)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de7e6416-6f05-4921-a16a-25e59abe8ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de7e6416-6f05-4921-a16a-25e59abe8ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (926bb4ea-b314-42b0-b50c-5b7dc8a2f5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (926bb4ea-b314-42b0-b50c-5b7dc8a2f5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b5997d1-d9ff-425a-afa0-ccb3bc8eef3e', 'volume_name': 'volume-1b5997d1-d9ff-425a-afa0-ccb3bc8eef3e', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05370457-424e-46ee-8ee8-9b8a64b13e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05370457-424e-46ee-8ee8-9b8a64b13e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d33d671-fb03-4028-b265-7bf5dd62db4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:29 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Volume 1b5997d1-d9ff-425a-afa0-ccb3bc8eef3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b5997d1-d9ff-425a-afa0-ccb3bc8eef3e', 'volume_size': 1}
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:29 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-1f616bc0-cbc3-407f-b01f-876989356a30 req-ca529793-5a16-4a86-923c-779b4c25452b tempest-AttachVolumeTestJSON-933021987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4b1af832-4df9-4257-8782-f81764370c12" returned: 0 in 0.868s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-1f616bc0-cbc3-407f-b01f-876989356a30 req-ca529793-5a16-4a86-923c-779b4c25452b tempest-AttachVolumeTestJSON-933021987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.913s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9eb88439-439b-471e-b709-86010e012cff,created_at=2026-07-03T11:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-71160517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9eb88439-439b-471e-b709-86010e012cff,host='devstack@QuobyteHD#QuobyteHD',id=1b5997d1-d9ff-425a-afa0-ccb3bc8eef3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be73edd5362418cb1f86404924ac2f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:30Z,use_quota=True,user_id='dba3dfb5e0b24b24a686a6be4711507f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff66d518-1c86-471b-b9ba-3b80983210f4),volume_type_id=ff66d518-1c86-471b-b9ba-3b80983210f4)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Creating volume 1b5997d1-d9ff-425a-afa0-ccb3bc8eef3e {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:10:29 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1b5997d1-d9ff-425a-afa0-ccb3bc8eef3e 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:29 devstack sudo[98188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1b5997d1-d9ff-425a-afa0-ccb3bc8eef3e 1073741824
Jul 03 13:10:29 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:29 devstack sudo[98187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_9u3nh603devstack@QuobyteHD
Jul 03 13:10:29 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-1f616bc0-cbc3-407f-b01f-876989356a30 req-ca529793-5a16-4a86-923c-779b4c25452b tempest-AttachVolumeTestJSON-933021987 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db', 'name': 'volume-4b1af832-4df9-4257-8782-f81764370c12', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '70a49dd8-7180-44ef-bd42-a0a52348bada', 'enforce_multipath': True} {{(pid=86837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 13:10:30 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-1f616bc0-cbc3-407f-b01f-876989356a30 req-ca529793-5a16-4a86-923c-779b4c25452b tempest-AttachVolumeTestJSON-933021987 None] attachment_update completed successfully.
Jul 03 13:10:30 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1ddfbfc7-1b4c-41bb-b70e-fb2e0124a11f tempest-VolumesTransfersTest-105076284 None] Acquiring lock "cinder-7f684534-3e60-49ff-8751-3f67a41f7416-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:30 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1ddfbfc7-1b4c-41bb-b70e-fb2e0124a11f tempest-VolumesTransfersTest-105076284 None] Lock "cinder-7f684534-3e60-49ff-8751-3f67a41f7416-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:30 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1ddfbfc7-1b4c-41bb-b70e-fb2e0124a11f tempest-VolumesTransfersTest-105076284 None] Acquiring lock "cinder-quobyte-7f684534-3e60-49ff-8751-3f67a41f7416" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:30 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1ddfbfc7-1b4c-41bb-b70e-fb2e0124a11f tempest-VolumesTransfersTest-105076284 None] Lock "cinder-quobyte-7f684534-3e60-49ff-8751-3f67a41f7416" acquired by "delete_volume" :: waited 0.017s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:30 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbc4c29-8ea3-41ce-8357-fe287d265a95]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1ddfbfc7-1b4c-41bb-b70e-fb2e0124a11f tempest-VolumesTransfersTest-105076284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7f684534-3e60-49ff-8751-3f67a41f7416 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:30 devstack sudo[98191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7f684534-3e60-49ff-8751-3f67a41f7416
Jul 03 13:10:30 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:30 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_9u3nh603devstack@QuobyteHD" returned: 1 in 0.978s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_9u3nh603devstack@QuobyteHD' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:10:30 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] f0faf5f7-c25d-4c9f-b059-dea2e65b32a5 was raw, converting to raw {{(pid=86837) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 03 13:10:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_9u3nh603devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:30 devstack sudo[98267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_9u3nh603devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf
Jul 03 13:10:30 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:30 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1b5997d1-d9ff-425a-afa0-ccb3bc8eef3e 1073741824" returned: 0 in 0.938s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1b5997d1-d9ff-425a-afa0-ccb3bc8eef3e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:30 devstack sudo[98269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1b5997d1-d9ff-425a-afa0-ccb3bc8eef3e
Jul 03 13:10:30 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:31 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1ddfbfc7-1b4c-41bb-b70e-fb2e0124a11f tempest-VolumesTransfersTest-105076284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7f684534-3e60-49ff-8751-3f67a41f7416" returned: 0 in 0.933s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1ddfbfc7-1b4c-41bb-b70e-fb2e0124a11f tempest-VolumesTransfersTest-105076284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7f684534-3e60-49ff-8751-3f67a41f7416 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:31 devstack sudo[98590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7f684534-3e60-49ff-8751-3f67a41f7416
Jul 03 13:10:31 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:31 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1b5997d1-d9ff-425a-afa0-ccb3bc8eef3e" returned: 0 in 0.801s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:10:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:31 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_9u3nh603devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf" returned: 0 in 0.911s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:31 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f0faf5f7-c25d-4c9f-b059-dea2e65b32a5_9u3nh603devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf {{(pid=86837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 13:10:31 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Converted 0.00 MB image at 0.00 MB/s
Jul 03 13:10:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d33d671-fb03-4028-b265-7bf5dd62db4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b5997d1-d9ff-425a-afa0-ccb3bc8eef3e', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee55cc05-27a8-495b-b530-e48a6e20d7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:31 devstack sudo[98596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf 1G
Jul 03 13:10:31 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:31 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Volume volume-1b5997d1-d9ff-425a-afa0-ccb3bc8eef3e (1b5997d1-d9ff-425a-afa0-ccb3bc8eef3e): created successfully
Jul 03 13:10:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee55cc05-27a8-495b-b530-e48a6e20d7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Flow 'volume_create_manager' (7f922097-84a4-4908-a4f6-62e56f9dc4ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:31 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-ca787f23-b292-470b-9b2d-9d32529fab91 tempest-GroupsTest-1202386914 None] Created volume successfully.
Jul 03 13:10:32 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1ddfbfc7-1b4c-41bb-b70e-fb2e0124a11f tempest-VolumesTransfersTest-105076284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7f684534-3e60-49ff-8751-3f67a41f7416" returned: 0 in 0.756s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:32 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1ddfbfc7-1b4c-41bb-b70e-fb2e0124a11f tempest-VolumesTransfersTest-105076284 None] Lock "cinder-quobyte-7f684534-3e60-49ff-8751-3f67a41f7416" released by "delete_volume" :: held 1.770s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:32 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-1ddfbfc7-1b4c-41bb-b70e-fb2e0124a11f tempest-VolumesTransfersTest-105076284 None] Created reservations ['d95e7f5c-469a-46aa-b548-c0ba11c117ac', '3467a25b-4483-4486-8475-4fa523ed0741', '55e77e51-5185-4d94-8feb-e59bbca7764d', '97575fe8-750e-45f0-93da-d447cc4c3fba'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:10:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1ddfbfc7-1b4c-41bb-b70e-fb2e0124a11f tempest-VolumesTransfersTest-105076284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1ddfbfc7-1b4c-41bb-b70e-fb2e0124a11f tempest-VolumesTransfersTest-105076284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1ddfbfc7-1b4c-41bb-b70e-fb2e0124a11f tempest-VolumesTransfersTest-105076284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1ddfbfc7-1b4c-41bb-b70e-fb2e0124a11f tempest-VolumesTransfersTest-105076284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1ddfbfc7-1b4c-41bb-b70e-fb2e0124a11f tempest-VolumesTransfersTest-105076284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1ddfbfc7-1b4c-41bb-b70e-fb2e0124a11f tempest-VolumesTransfersTest-105076284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:32 devstack sudo[98602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:10:32 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:32 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf 1G" returned: 0 in 0.780s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:32 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9aae222-d0ba-40e4-b18b-97078c03ce54]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:32 devstack sudo[98604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf
Jul 03 13:10:32 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:32 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:10:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Flow 'volume_create_manager' (88fd9f88-065c-44d4-8ff2-7a46d045e4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f10b9f3-8eb7-494f-a062-359aa6dad4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f10b9f3-8eb7-494f-a062-359aa6dad4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2036244272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9eb88439-439b-471e-b709-86010e012cff,host='devstack@QuobyteHD#QuobyteHD',id=ad6083cb-229e-4e26-a509-7fc6113a21d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be73edd5362418cb1f86404924ac2f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:33Z,use_quota=True,user_id='dba3dfb5e0b24b24a686a6be4711507f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff66d518-1c86-471b-b9ba-3b80983210f4),volume_type_id=ff66d518-1c86-471b-b9ba-3b80983210f4)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae2ccef4-ae88-4592-a3e4-8d7d4ef61e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae2ccef4-ae88-4592-a3e4-8d7d4ef61e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0651f111-bfa2-470c-ab5f-b39ade1754b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0651f111-bfa2-470c-ab5f-b39ade1754b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad6083cb-229e-4e26-a509-7fc6113a21d4', 'volume_name': 'volume-ad6083cb-229e-4e26-a509-7fc6113a21d4', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (050a7c1a-2a74-441c-a5fd-9df3b0f706b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (050a7c1a-2a74-441c-a5fd-9df3b0f706b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0659a0c8-57b7-451d-a792-bec7cd2937f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:33 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Volume ad6083cb-229e-4e26-a509-7fc6113a21d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad6083cb-229e-4e26-a509-7fc6113a21d4', 'volume_size': 1}
Jul 03 13:10:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:33 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9eb88439-439b-471e-b709-86010e012cff,created_at=2026-07-03T11:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2036244272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9eb88439-439b-471e-b709-86010e012cff,host='devstack@QuobyteHD#QuobyteHD',id=ad6083cb-229e-4e26-a509-7fc6113a21d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be73edd5362418cb1f86404924ac2f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:33Z,use_quota=True,user_id='dba3dfb5e0b24b24a686a6be4711507f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff66d518-1c86-471b-b9ba-3b80983210f4),volume_type_id=ff66d518-1c86-471b-b9ba-3b80983210f4)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:10:33 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Creating volume ad6083cb-229e-4e26-a509-7fc6113a21d4 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:10:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:33 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:33 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:33 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:10:33 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:10:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ad6083cb-229e-4e26-a509-7fc6113a21d4 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:33 devstack sudo[98608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ad6083cb-229e-4e26-a509-7fc6113a21d4 1073741824
Jul 03 13:10:33 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:33 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1ddfbfc7-1b4c-41bb-b70e-fb2e0124a11f tempest-VolumesTransfersTest-105076284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.939s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:33 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-1ddfbfc7-1b4c-41bb-b70e-fb2e0124a11f tempest-VolumesTransfersTest-105076284 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:10:33 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-1ddfbfc7-1b4c-41bb-b70e-fb2e0124a11f tempest-VolumesTransfersTest-105076284 None] Deleted volume successfully.
Jul 03 13:10:33 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1ddfbfc7-1b4c-41bb-b70e-fb2e0124a11f tempest-VolumesTransfersTest-105076284 None] Lock "cinder-7f684534-3e60-49ff-8751-3f67a41f7416-delete_volume" released by "delete_volume" :: held 3.012s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:33 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf" returned: 0 in 1.034s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:33 devstack sudo[98612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf
Jul 03 13:10:33 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:34 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ad6083cb-229e-4e26-a509-7fc6113a21d4 1073741824" returned: 0 in 1.026s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ad6083cb-229e-4e26-a509-7fc6113a21d4 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:34 devstack sudo[98618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ad6083cb-229e-4e26-a509-7fc6113a21d4
Jul 03 13:10:34 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:34 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf" returned: 1 in 0.975s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:10:34 devstack cinder-volume[86837]: DEBUG cinder.volume.volume_utils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Downloaded image f0faf5f7-c25d-4c9f-b059-dea2e65b32a5 ((None, [{'url': 'file:///opt/stack/data/glance/images/f0faf5f7-c25d-4c9f-b059-dea2e65b32a5', 'metadata': {}}])) to volume bdf1507d-68e3-4055-9bab-e7118e7fc3bf successfully. {{(pid=86837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 03 13:10:34 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Temporary image f0faf5f7-c25d-4c9f-b059-dea2e65b32a5 for user 3b7d76bd4cd0499db29ec97526daf1e8 is deleted. {{(pid=86837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 03 13:10:34 devstack cinder-volume[86837]: DEBUG cinder.volume.volume_utils [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Marking volume bdf1507d-68e3-4055-9bab-e7118e7fc3bf as bootable. {{(pid=86837) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 03 13:10:34 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Copying metadata from image f0faf5f7-c25d-4c9f-b059-dea2e65b32a5 to bdf1507d-68e3-4055-9bab-e7118e7fc3bf. {{(pid=86837) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 13:10:34 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Creating volume glance metadata for volume bdf1507d-68e3-4055-9bab-e7118e7fc3bf backed by image f0faf5f7-c25d-4c9f-b059-dea2e65b32a5 with: {'image_id': 'f0faf5f7-c25d-4c9f-b059-dea2e65b32a5', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a196fc42425eb7138c512eb5fb97b081', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86837) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 13:10:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5051507-7c33-4d30-841b-acaca31aefd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf', 'volume_size': 1, 'image_id': 'f0faf5f7-c25d-4c9f-b059-dea2e65b32a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f0faf5f7-c25d-4c9f-b059-dea2e65b32a5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a196fc42425eb7138c512eb5fb97b081', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8320171bf11c47fea4b1749a1ab45e8e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f669a747363d5fd02789ae9b4eaf19e98f8a3f9775d56b2dd6fe3162227ca133042960840efdb784db5784cbb508ac99abcd64adf8aa2d5f92f9a8456c813cab', 'id': 'f0faf5f7-c25d-4c9f-b059-dea2e65b32a5', 'created_at': datetime.datetime(2026, 7, 3, 11, 10, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 10, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f0faf5f7-c25d-4c9f-b059-dea2e65b32a5/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7aa53bfdfc80>}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9038d0c-d0f1-40b7-a267-9573030544e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:34 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Volume volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf (bdf1507d-68e3-4055-9bab-e7118e7fc3bf): created successfully
Jul 03 13:10:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9038d0c-d0f1-40b7-a267-9573030544e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Flow 'volume_create_manager' (f75fc582-6b19-4000-bb48-4a8d79ee52ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:34 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-9fccaf66-208f-4cfa-b2ec-3c646e8bf642 tempest-VolumeImageDependencyTests-163232407 None] Created volume successfully.
Jul 03 13:10:35 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ad6083cb-229e-4e26-a509-7fc6113a21d4" returned: 0 in 0.911s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0659a0c8-57b7-451d-a792-bec7cd2937f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad6083cb-229e-4e26-a509-7fc6113a21d4', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04a0e89b-3240-4bf7-be2e-a4087b6edbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:35 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Volume volume-ad6083cb-229e-4e26-a509-7fc6113a21d4 (ad6083cb-229e-4e26-a509-7fc6113a21d4): created successfully
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04a0e89b-3240-4bf7-be2e-a4087b6edbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Flow 'volume_create_manager' (88fd9f88-065c-44d4-8ff2-7a46d045e4ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:35 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-5e3e5cac-b449-4af7-b100-cd8662881f59 tempest-GroupsTest-1202386914 None] Created volume successfully.
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Flow 'volume_create_manager' (4afba216-c671-4f6f-ab0e-5d5d47c96155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428bf6c6-0505-472e-8830-ed2a574972f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428bf6c6-0505-472e-8830-ed2a574972f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1947682798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb656c5-0bff-40d1-b657-9ca28eecfd5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a53b8c83c4342578010aeced7d6db52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:35Z,use_quota=True,user_id='20c01da34cf44404bed466cb2b241407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f47eb6c5-08e1-4cf3-ac0c-9316c9ac2eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f47eb6c5-08e1-4cf3-ac0c-9316c9ac2eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8614846f-d741-42fe-8460-94b1f322d0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8614846f-d741-42fe-8460-94b1f322d0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cb656c5-0bff-40d1-b657-9ca28eecfd5e', 'volume_name': 'volume-7cb656c5-0bff-40d1-b657-9ca28eecfd5e', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9cd40a-e56c-4eae-a0aa-489927650ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9cd40a-e56c-4eae-a0aa-489927650ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a7f4e70-623d-4d6e-abed-d09feec5f230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:35 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Volume 7cb656c5-0bff-40d1-b657-9ca28eecfd5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cb656c5-0bff-40d1-b657-9ca28eecfd5e', 'volume_size': 1}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1947682798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb656c5-0bff-40d1-b657-9ca28eecfd5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a53b8c83c4342578010aeced7d6db52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:35Z,use_quota=True,user_id='20c01da34cf44404bed466cb2b241407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Creating volume 7cb656c5-0bff-40d1-b657-9ca28eecfd5e {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:10:35 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7cb656c5-0bff-40d1-b657-9ca28eecfd5e 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:35 devstack sudo[98625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7cb656c5-0bff-40d1-b657-9ca28eecfd5e 1073741824
Jul 03 13:10:35 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2f0a3ec9-1f87-4712-81cd-dad08ff4f5f4 tempest-VolumeImageDependencyTests-163232407 None] Acquiring lock "cinder-bdf1507d-68e3-4055-9bab-e7118e7fc3bf-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2f0a3ec9-1f87-4712-81cd-dad08ff4f5f4 tempest-VolumeImageDependencyTests-163232407 None] Lock "cinder-bdf1507d-68e3-4055-9bab-e7118e7fc3bf-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:35 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-e8d67260-67df-467f-9fc3-6c2069cd738d tempest-GroupsTest-1202386914 None] Update group completed successfully.
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2f0a3ec9-1f87-4712-81cd-dad08ff4f5f4 tempest-VolumeImageDependencyTests-163232407 None] Acquiring lock "cinder-quobyte-bdf1507d-68e3-4055-9bab-e7118e7fc3bf" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2f0a3ec9-1f87-4712-81cd-dad08ff4f5f4 tempest-VolumeImageDependencyTests-163232407 None] Lock "cinder-quobyte-bdf1507d-68e3-4055-9bab-e7118e7fc3bf" acquired by "delete_volume" :: waited 0.016s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f0121b-370e-4e9e-bce6-485451fb792a]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2f0a3ec9-1f87-4712-81cd-dad08ff4f5f4 tempest-VolumeImageDependencyTests-163232407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:35 devstack sudo[98627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf
Jul 03 13:10:35 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:36 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7cb656c5-0bff-40d1-b657-9ca28eecfd5e 1073741824" returned: 0 in 0.975s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7cb656c5-0bff-40d1-b657-9ca28eecfd5e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:36 devstack sudo[98635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7cb656c5-0bff-40d1-b657-9ca28eecfd5e
Jul 03 13:10:36 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:36 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2f0a3ec9-1f87-4712-81cd-dad08ff4f5f4 tempest-VolumeImageDependencyTests-163232407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf" returned: 0 in 0.850s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2f0a3ec9-1f87-4712-81cd-dad08ff4f5f4 tempest-VolumeImageDependencyTests-163232407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:36 devstack sudo[98637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf
Jul 03 13:10:36 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:37 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-3ecf8aad-3949-4cf6-8eef-d49e76dfe2e4 tempest-GroupsTest-1202386914 None] Update group completed successfully.
Jul 03 13:10:37 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7cb656c5-0bff-40d1-b657-9ca28eecfd5e" returned: 0 in 0.837s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:10:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a7f4e70-623d-4d6e-abed-d09feec5f230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cb656c5-0bff-40d1-b657-9ca28eecfd5e', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50eb0e54-210e-47d2-bd07-15deaa15353c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:37 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Volume volume-7cb656c5-0bff-40d1-b657-9ca28eecfd5e (7cb656c5-0bff-40d1-b657-9ca28eecfd5e): created successfully
Jul 03 13:10:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50eb0e54-210e-47d2-bd07-15deaa15353c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Flow 'volume_create_manager' (4afba216-c671-4f6f-ab0e-5d5d47c96155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:37 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-49917b8b-75a3-4e5c-80f4-5de9a733a2c5 tempest-AttachVolumeTestJSON-933021987 None] Created volume successfully.
Jul 03 13:10:37 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2f0a3ec9-1f87-4712-81cd-dad08ff4f5f4 tempest-VolumeImageDependencyTests-163232407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf" returned: 1 in 0.921s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2f0a3ec9-1f87-4712-81cd-dad08ff4f5f4 tempest-VolumeImageDependencyTests-163232407 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:10:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2f0a3ec9-1f87-4712-81cd-dad08ff4f5f4 tempest-VolumeImageDependencyTests-163232407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:37 devstack sudo[98643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf
Jul 03 13:10:37 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:38 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2f0a3ec9-1f87-4712-81cd-dad08ff4f5f4 tempest-VolumeImageDependencyTests-163232407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bdf1507d-68e3-4055-9bab-e7118e7fc3bf" returned: 0 in 0.678s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:38 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2f0a3ec9-1f87-4712-81cd-dad08ff4f5f4 tempest-VolumeImageDependencyTests-163232407 None] Lock "cinder-quobyte-bdf1507d-68e3-4055-9bab-e7118e7fc3bf" released by "delete_volume" :: held 2.518s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:38 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-2f0a3ec9-1f87-4712-81cd-dad08ff4f5f4 tempest-VolumeImageDependencyTests-163232407 None] Created reservations ['b8970746-7345-4d0b-8910-74eb1ce92f26', 'e06375c2-2990-4653-9243-5ce165b70ee6', '3f068ebc-840e-4130-b9ef-1c17a63a430e', '1a29c46f-10ee-458e-b49e-0e7057a77645'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:10:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-2f0a3ec9-1f87-4712-81cd-dad08ff4f5f4 tempest-VolumeImageDependencyTests-163232407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-2f0a3ec9-1f87-4712-81cd-dad08ff4f5f4 tempest-VolumeImageDependencyTests-163232407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:38 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-2f0a3ec9-1f87-4712-81cd-dad08ff4f5f4 tempest-VolumeImageDependencyTests-163232407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:38 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-2f0a3ec9-1f87-4712-81cd-dad08ff4f5f4 tempest-VolumeImageDependencyTests-163232407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-2f0a3ec9-1f87-4712-81cd-dad08ff4f5f4 tempest-VolumeImageDependencyTests-163232407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2f0a3ec9-1f87-4712-81cd-dad08ff4f5f4 tempest-VolumeImageDependencyTests-163232407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:38 devstack sudo[98646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:10:38 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:38 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e6d2bd5e-44ca-4f76-a558-66bfdc542630 tempest-GroupsTest-1202386914 None] Acquiring lock "cinder-quobyte-1b5997d1-d9ff-425a-afa0-ccb3bc8eef3e" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:38 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e6d2bd5e-44ca-4f76-a558-66bfdc542630 tempest-GroupsTest-1202386914 None] Lock "cinder-quobyte-1b5997d1-d9ff-425a-afa0-ccb3bc8eef3e" acquired by "delete_volume" :: waited 0.017s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:38 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2436a2-bb6f-47dd-9e9a-a4270375f3d2]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e6d2bd5e-44ca-4f76-a558-66bfdc542630 tempest-GroupsTest-1202386914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1b5997d1-d9ff-425a-afa0-ccb3bc8eef3e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:39 devstack sudo[98651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1b5997d1-d9ff-425a-afa0-ccb3bc8eef3e
Jul 03 13:10:39 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:39 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2f0a3ec9-1f87-4712-81cd-dad08ff4f5f4 tempest-VolumeImageDependencyTests-163232407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.733s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:39 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-2f0a3ec9-1f87-4712-81cd-dad08ff4f5f4 tempest-VolumeImageDependencyTests-163232407 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:10:39 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-2f0a3ec9-1f87-4712-81cd-dad08ff4f5f4 tempest-VolumeImageDependencyTests-163232407 None] Deleted volume successfully.
Jul 03 13:10:39 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2f0a3ec9-1f87-4712-81cd-dad08ff4f5f4 tempest-VolumeImageDependencyTests-163232407 None] Lock "cinder-bdf1507d-68e3-4055-9bab-e7118e7fc3bf-delete_volume" released by "delete_volume" :: held 3.517s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:39 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:10:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Flow 'volume_create_manager' (efb5ea84-4e93-4ae1-a346-7d22b6ab68ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416279e6-83c1-4ab7-9b85-5ffd25573411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416279e6-83c1-4ab7-9b85-5ffd25573411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-288335096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b99f36-e5b8-4fb7-a44c-241a672b75dc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='41f3d519e48d44dfa81cc5bd48f8acee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:40Z,use_quota=True,user_id='97064b55755d41f1849fde163b43474a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4dce7ce-8c26-42e6-94e9-7337cbc1e5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4dce7ce-8c26-42e6-94e9-7337cbc1e5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e4f8f9-63ec-40fd-ba8d-82e64b1b4e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e4f8f9-63ec-40fd-ba8d-82e64b1b4e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25b99f36-e5b8-4fb7-a44c-241a672b75dc', 'volume_name': 'volume-25b99f36-e5b8-4fb7-a44c-241a672b75dc', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7424056-b9fe-4207-b4cb-8f512bddaa0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7424056-b9fe-4207-b4cb-8f512bddaa0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e8f44a1-8e27-46ca-b895-d684817ed801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:39 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Volume 25b99f36-e5b8-4fb7-a44c-241a672b75dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25b99f36-e5b8-4fb7-a44c-241a672b75dc', 'volume_size': 1}
Jul 03 13:10:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-288335096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b99f36-e5b8-4fb7-a44c-241a672b75dc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='41f3d519e48d44dfa81cc5bd48f8acee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:40Z,use_quota=True,user_id='97064b55755d41f1849fde163b43474a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:10:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Creating volume 25b99f36-e5b8-4fb7-a44c-241a672b75dc {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:10:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:10:39 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:10:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25b99f36-e5b8-4fb7-a44c-241a672b75dc 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:39 devstack sudo[98657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25b99f36-e5b8-4fb7-a44c-241a672b75dc 1073741824
Jul 03 13:10:39 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:39 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e6d2bd5e-44ca-4f76-a558-66bfdc542630 tempest-GroupsTest-1202386914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1b5997d1-d9ff-425a-afa0-ccb3bc8eef3e" returned: 0 in 0.994s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e6d2bd5e-44ca-4f76-a558-66bfdc542630 tempest-GroupsTest-1202386914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1b5997d1-d9ff-425a-afa0-ccb3bc8eef3e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:39 devstack sudo[98659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1b5997d1-d9ff-425a-afa0-ccb3bc8eef3e
Jul 03 13:10:39 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:40 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e6d2bd5e-44ca-4f76-a558-66bfdc542630 tempest-GroupsTest-1202386914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1b5997d1-d9ff-425a-afa0-ccb3bc8eef3e" returned: 0 in 0.790s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e6d2bd5e-44ca-4f76-a558-66bfdc542630 tempest-GroupsTest-1202386914 None] Lock "cinder-quobyte-1b5997d1-d9ff-425a-afa0-ccb3bc8eef3e" released by "delete_volume" :: held 1.851s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e6d2bd5e-44ca-4f76-a558-66bfdc542630 tempest-GroupsTest-1202386914 None] Acquiring lock "cinder-quobyte-ad6083cb-229e-4e26-a509-7fc6113a21d4" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e6d2bd5e-44ca-4f76-a558-66bfdc542630 tempest-GroupsTest-1202386914 None] Lock "cinder-quobyte-ad6083cb-229e-4e26-a509-7fc6113a21d4" acquired by "delete_volume" :: waited 0.016s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:40 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38a413b-aac9-4573-9bac-753cb013f580]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e6d2bd5e-44ca-4f76-a558-66bfdc542630 tempest-GroupsTest-1202386914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ad6083cb-229e-4e26-a509-7fc6113a21d4 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:40 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25b99f36-e5b8-4fb7-a44c-241a672b75dc 1073741824" returned: 0 in 1.008s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25b99f36-e5b8-4fb7-a44c-241a672b75dc {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:40 devstack sudo[98667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25b99f36-e5b8-4fb7-a44c-241a672b75dc
Jul 03 13:10:40 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:40 devstack sudo[98666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ad6083cb-229e-4e26-a509-7fc6113a21d4
Jul 03 13:10:40 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:41 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25b99f36-e5b8-4fb7-a44c-241a672b75dc" returned: 0 in 0.829s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] <== create_volume: return (1892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:10:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e8f44a1-8e27-46ca-b895-d684817ed801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25b99f36-e5b8-4fb7-a44c-241a672b75dc', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bae590-58fc-49c6-a2ce-5420ee86936c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:41 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Volume volume-25b99f36-e5b8-4fb7-a44c-241a672b75dc (25b99f36-e5b8-4fb7-a44c-241a672b75dc): created successfully
Jul 03 13:10:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bae590-58fc-49c6-a2ce-5420ee86936c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Flow 'volume_create_manager' (efb5ea84-4e93-4ae1-a346-7d22b6ab68ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:41 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-0136e42a-9895-4948-8231-23bb91140151 tempest-VolumesGetTest-1922388409 None] Created volume successfully.
Jul 03 13:10:41 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e6d2bd5e-44ca-4f76-a558-66bfdc542630 tempest-GroupsTest-1202386914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ad6083cb-229e-4e26-a509-7fc6113a21d4" returned: 0 in 1.036s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e6d2bd5e-44ca-4f76-a558-66bfdc542630 tempest-GroupsTest-1202386914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ad6083cb-229e-4e26-a509-7fc6113a21d4 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:41 devstack sudo[98674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ad6083cb-229e-4e26-a509-7fc6113a21d4
Jul 03 13:10:41 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-33fe5d25-4f69-4e67-b903-5b55240e022d req-e6d04bf0-b578-4fe1-a5af-d3e055af5040 tempest-AttachVolumeTestJSON-933021987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-33fe5d25-4f69-4e67-b903-5b55240e022d req-e6d04bf0-b578-4fe1-a5af-d3e055af5040 tempest-AttachVolumeTestJSON-933021987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:42 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69f1446-25b6-40ed-8aa5-17c565d8acf4]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-33fe5d25-4f69-4e67-b903-5b55240e022d req-e6d04bf0-b578-4fe1-a5af-d3e055af5040 tempest-AttachVolumeTestJSON-933021987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7cb656c5-0bff-40d1-b657-9ca28eecfd5e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:42 devstack sudo[98684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7cb656c5-0bff-40d1-b657-9ca28eecfd5e
Jul 03 13:10:42 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:42 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e6d2bd5e-44ca-4f76-a558-66bfdc542630 tempest-GroupsTest-1202386914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ad6083cb-229e-4e26-a509-7fc6113a21d4" returned: 0 in 0.760s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e6d2bd5e-44ca-4f76-a558-66bfdc542630 tempest-GroupsTest-1202386914 None] Lock "cinder-quobyte-ad6083cb-229e-4e26-a509-7fc6113a21d4" released by "delete_volume" :: held 1.861s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:42 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-e6d2bd5e-44ca-4f76-a558-66bfdc542630 tempest-GroupsTest-1202386914 None] Created reservations ['88456b0b-83e8-41dc-a66a-9a3c0a1d7d05'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:10:42 devstack cinder-volume[86837]: WARNING cinder.quota [None req-e6d2bd5e-44ca-4f76-a558-66bfdc542630 tempest-GroupsTest-1202386914 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1316938215 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1316938215, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:10:42 devstack cinder-volume[86837]: WARNING cinder.quota [None req-e6d2bd5e-44ca-4f76-a558-66bfdc542630 tempest-GroupsTest-1202386914 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1316938215 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1316938215, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:10:42 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-e6d2bd5e-44ca-4f76-a558-66bfdc542630 tempest-GroupsTest-1202386914 None] Created reservations ['c0274da9-cdb0-4581-a22e-0f32179e6476', 'dd6acf1c-2c19-42a7-ba2e-b0eb5256a613', '5dc6a23c-e564-4efa-ba7a-f750e265b20b', '0ea45144-895c-410d-a8aa-850f3a438a90'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:10:42 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-e6d2bd5e-44ca-4f76-a558-66bfdc542630 tempest-GroupsTest-1202386914 None] Created reservations ['bde933df-4941-4678-bf56-104fd16332bd', 'bf59e3d0-df64-448c-8f6e-33958cf71af8', '5c2b776b-11f2-46b6-ace1-a168c4801508', '65329965-b1b9-4fc8-804a-556c026fce30'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:10:43 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-33fe5d25-4f69-4e67-b903-5b55240e022d req-e6d04bf0-b578-4fe1-a5af-d3e055af5040 tempest-AttachVolumeTestJSON-933021987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7cb656c5-0bff-40d1-b657-9ca28eecfd5e" returned: 0 in 0.962s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-33fe5d25-4f69-4e67-b903-5b55240e022d req-e6d04bf0-b578-4fe1-a5af-d3e055af5040 tempest-AttachVolumeTestJSON-933021987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.984s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-33fe5d25-4f69-4e67-b903-5b55240e022d req-e6d04bf0-b578-4fe1-a5af-d3e055af5040 tempest-AttachVolumeTestJSON-933021987 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db', 'name': 'volume-7cb656c5-0bff-40d1-b657-9ca28eecfd5e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b39d98b0-55e2-4796-a752-49992d87e582', 'enforce_multipath': True} {{(pid=86837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 13:10:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e6d2bd5e-44ca-4f76-a558-66bfdc542630 tempest-GroupsTest-1202386914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e6d2bd5e-44ca-4f76-a558-66bfdc542630 tempest-GroupsTest-1202386914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:43 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e6d2bd5e-44ca-4f76-a558-66bfdc542630 tempest-GroupsTest-1202386914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:43 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e6d2bd5e-44ca-4f76-a558-66bfdc542630 tempest-GroupsTest-1202386914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e6d2bd5e-44ca-4f76-a558-66bfdc542630 tempest-GroupsTest-1202386914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e6d2bd5e-44ca-4f76-a558-66bfdc542630 tempest-GroupsTest-1202386914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:43 devstack sudo[98691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:10:43 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-33fe5d25-4f69-4e67-b903-5b55240e022d req-e6d04bf0-b578-4fe1-a5af-d3e055af5040 tempest-AttachVolumeTestJSON-933021987 None] attachment_update completed successfully.
Jul 03 13:10:43 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:44 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:10:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Flow 'volume_create_manager' (ec483400-13d6-432e-92b7-407379cdd1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20d02e9-0b6d-4203-aa13-a175df044291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20d02e9-0b6d-4203-aa13-a175df044291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:10:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-723321607',display_name='tempest-VolumesGetTest-Volume-1017964325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58453352-03ca-4b03-9a8c-0c18346f08b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41f3d519e48d44dfa81cc5bd48f8acee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:44Z,use_quota=True,user_id='97064b55755d41f1849fde163b43474a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d6fcc7a-7d40-4d20-a240-075dc9db629e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d6fcc7a-7d40-4d20-a240-075dc9db629e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa1fd511-b247-42f3-9a17-ee3f2000b165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa1fd511-b247-42f3-9a17-ee3f2000b165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58453352-03ca-4b03-9a8c-0c18346f08b9', 'volume_name': 'volume-58453352-03ca-4b03-9a8c-0c18346f08b9', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94f19b64-eed7-4405-9252-c3920f6a19da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94f19b64-eed7-4405-9252-c3920f6a19da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b029ffd3-2347-454f-9703-d384b4f099e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:44 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Volume 58453352-03ca-4b03-9a8c-0c18346f08b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58453352-03ca-4b03-9a8c-0c18346f08b9', 'volume_size': 1}
Jul 03 13:10:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:10:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-723321607',display_name='tempest-VolumesGetTest-Volume-1017964325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58453352-03ca-4b03-9a8c-0c18346f08b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41f3d519e48d44dfa81cc5bd48f8acee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:44Z,use_quota=True,user_id='97064b55755d41f1849fde163b43474a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:10:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Creating volume 58453352-03ca-4b03-9a8c-0c18346f08b9 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:10:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:10:44 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:10:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-58453352-03ca-4b03-9a8c-0c18346f08b9 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:44 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e6d2bd5e-44ca-4f76-a558-66bfdc542630 tempest-GroupsTest-1202386914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.012s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:44 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-e6d2bd5e-44ca-4f76-a558-66bfdc542630 tempest-GroupsTest-1202386914 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:10:44 devstack sudo[98694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-58453352-03ca-4b03-9a8c-0c18346f08b9 1073741824
Jul 03 13:10:44 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:44 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-e6d2bd5e-44ca-4f76-a558-66bfdc542630 tempest-GroupsTest-1202386914 None] Delete group completed successfully.
Jul 03 13:10:45 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-58453352-03ca-4b03-9a8c-0c18346f08b9 1073741824" returned: 0 in 1.107s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-58453352-03ca-4b03-9a8c-0c18346f08b9 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:45 devstack sudo[98702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-58453352-03ca-4b03-9a8c-0c18346f08b9
Jul 03 13:10:45 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:46 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-58453352-03ca-4b03-9a8c-0c18346f08b9" returned: 0 in 0.810s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:46 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] <== create_volume: return (1972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:10:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:46 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b029ffd3-2347-454f-9703-d384b4f099e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58453352-03ca-4b03-9a8c-0c18346f08b9', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:46 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bffe41e-bef3-458e-9353-3ac3ce0e7131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:46 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Volume volume-58453352-03ca-4b03-9a8c-0c18346f08b9 (58453352-03ca-4b03-9a8c-0c18346f08b9): created successfully
Jul 03 13:10:46 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bffe41e-bef3-458e-9353-3ac3ce0e7131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:46 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Flow 'volume_create_manager' (ec483400-13d6-432e-92b7-407379cdd1f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:46 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-41caecc3-dfc9-4fd9-841a-0223d1047a9a tempest-VolumesGetTest-1922388409 None] Created volume successfully.
Jul 03 13:10:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-77681f41-491b-4e49-89f3-5f4030f1b2f5 tempest-VolumesGetTest-1922388409 None] Acquiring lock "cinder-58453352-03ca-4b03-9a8c-0c18346f08b9-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-77681f41-491b-4e49-89f3-5f4030f1b2f5 tempest-VolumesGetTest-1922388409 None] Lock "cinder-58453352-03ca-4b03-9a8c-0c18346f08b9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:47 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:INSERT=46,cinder:SELECT=135,cinder:UPDATE=165,cinder:DELETE=14 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:10:47 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=150,cinder:INSERT=43,cinder:UPDATE=157,cinder:DELETE=6 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:10:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-77681f41-491b-4e49-89f3-5f4030f1b2f5 tempest-VolumesGetTest-1922388409 None] Acquiring lock "cinder-quobyte-58453352-03ca-4b03-9a8c-0c18346f08b9" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-77681f41-491b-4e49-89f3-5f4030f1b2f5 tempest-VolumesGetTest-1922388409 None] Lock "cinder-quobyte-58453352-03ca-4b03-9a8c-0c18346f08b9" acquired by "delete_volume" :: waited 0.026s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:47 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[12026f1e-5de6-4bbb-9e76-ad5287e5fe37]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-77681f41-491b-4e49-89f3-5f4030f1b2f5 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-58453352-03ca-4b03-9a8c-0c18346f08b9 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:47 devstack sudo[98705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-58453352-03ca-4b03-9a8c-0c18346f08b9
Jul 03 13:10:47 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:48 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-77681f41-491b-4e49-89f3-5f4030f1b2f5 tempest-VolumesGetTest-1922388409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-58453352-03ca-4b03-9a8c-0c18346f08b9" returned: 0 in 1.177s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-77681f41-491b-4e49-89f3-5f4030f1b2f5 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-58453352-03ca-4b03-9a8c-0c18346f08b9 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:48 devstack sudo[98712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-58453352-03ca-4b03-9a8c-0c18346f08b9
Jul 03 13:10:48 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:49 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-77681f41-491b-4e49-89f3-5f4030f1b2f5 tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-58453352-03ca-4b03-9a8c-0c18346f08b9" returned: 0 in 0.782s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-77681f41-491b-4e49-89f3-5f4030f1b2f5 tempest-VolumesGetTest-1922388409 None] Lock "cinder-quobyte-58453352-03ca-4b03-9a8c-0c18346f08b9" released by "delete_volume" :: held 2.071s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:49 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-77681f41-491b-4e49-89f3-5f4030f1b2f5 tempest-VolumesGetTest-1922388409 None] Created reservations ['3afba43e-45f5-4df9-947f-c5dc539a7ab6', 'f3ef8cae-e9ba-4554-bcaa-7ca27b406d82', '75d3a4d3-ac6b-48f2-b755-29513e9fe930', '7ebc3842-5e24-42ce-bef0-8b9d18590c28'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:10:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-77681f41-491b-4e49-89f3-5f4030f1b2f5 tempest-VolumesGetTest-1922388409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-77681f41-491b-4e49-89f3-5f4030f1b2f5 tempest-VolumesGetTest-1922388409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-77681f41-491b-4e49-89f3-5f4030f1b2f5 tempest-VolumesGetTest-1922388409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-77681f41-491b-4e49-89f3-5f4030f1b2f5 tempest-VolumesGetTest-1922388409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-77681f41-491b-4e49-89f3-5f4030f1b2f5 tempest-VolumesGetTest-1922388409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-77681f41-491b-4e49-89f3-5f4030f1b2f5 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:49 devstack sudo[98716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:10:49 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:49 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-e85bdf77-6f56-4158-9f64-03d988033eaa req-08137ab4-4906-4531-bcbc-6d03a201714c tempest-AttachVolumeTestJSON-933021987 None] Terminate volume connection completed successfully.
Jul 03 13:10:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-e85bdf77-6f56-4158-9f64-03d988033eaa req-08137ab4-4906-4531-bcbc-6d03a201714c tempest-AttachVolumeTestJSON-933021987 None] Deleting attachment 70a49dd8-7180-44ef-bd42-a0a52348bada. {{(pid=86837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:10:50 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-77681f41-491b-4e49-89f3-5f4030f1b2f5 tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.784s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:50 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-77681f41-491b-4e49-89f3-5f4030f1b2f5 tempest-VolumesGetTest-1922388409 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:10:50 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-77681f41-491b-4e49-89f3-5f4030f1b2f5 tempest-VolumesGetTest-1922388409 None] Deleted volume successfully.
Jul 03 13:10:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-77681f41-491b-4e49-89f3-5f4030f1b2f5 tempest-VolumesGetTest-1922388409 None] Lock "cinder-58453352-03ca-4b03-9a8c-0c18346f08b9-delete_volume" released by "delete_volume" :: held 3.215s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:50 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-eb3a2e99-adf4-45be-a85d-12242674ea76 tempest-GroupsV314Test-1779044300 None] Group tempest-GroupsV314Test-Group-1081125787: creating
Jul 03 13:10:50 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-eb3a2e99-adf4-45be-a85d-12242674ea76 tempest-GroupsV314Test-1779044300 None] Group tempest-GroupsV314Test-Group-1081125787: created successfully
Jul 03 13:10:50 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-eb3a2e99-adf4-45be-a85d-12242674ea76 tempest-GroupsV314Test-1779044300 None] Create group completed successfully.
Jul 03 13:10:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cbde7724-9271-415c-b472-970ad9493697 tempest-VolumesGetTest-1922388409 None] Acquiring lock "cinder-25b99f36-e5b8-4fb7-a44c-241a672b75dc-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cbde7724-9271-415c-b472-970ad9493697 tempest-VolumesGetTest-1922388409 None] Lock "cinder-25b99f36-e5b8-4fb7-a44c-241a672b75dc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cbde7724-9271-415c-b472-970ad9493697 tempest-VolumesGetTest-1922388409 None] Acquiring lock "cinder-quobyte-25b99f36-e5b8-4fb7-a44c-241a672b75dc" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:10:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cbde7724-9271-415c-b472-970ad9493697 tempest-VolumesGetTest-1922388409 None] Lock "cinder-quobyte-25b99f36-e5b8-4fb7-a44c-241a672b75dc" acquired by "delete_volume" :: waited 0.033s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:10:51 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[250a024d-3209-415b-a1f8-04580628d029]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cbde7724-9271-415c-b472-970ad9493697 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25b99f36-e5b8-4fb7-a44c-241a672b75dc {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:51 devstack sudo[98746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25b99f36-e5b8-4fb7-a44c-241a672b75dc
Jul 03 13:10:51 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:52 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cbde7724-9271-415c-b472-970ad9493697 tempest-VolumesGetTest-1922388409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25b99f36-e5b8-4fb7-a44c-241a672b75dc" returned: 0 in 0.975s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cbde7724-9271-415c-b472-970ad9493697 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25b99f36-e5b8-4fb7-a44c-241a672b75dc {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:52 devstack sudo[98751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25b99f36-e5b8-4fb7-a44c-241a672b75dc
Jul 03 13:10:52 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:52 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:10:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Flow 'volume_create_manager' (e3980363-b8d4-468d-8009-9c2094bdf5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a99b58-b897-43fd-a5bd-5d727d81fdcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a99b58-b897-43fd-a5bd-5d727d81fdcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-184166441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4176c224-893c-4142-b35f-1dcde0650813,host='devstack@QuobyteHD#QuobyteHD',id=6520d0c3-c0f6-49f3-bef1-be75babd0e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8daf00869e5e4d5c8cc41a4944a1ba74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:52Z,use_quota=True,user_id='c4641d2d1f664720a26d852b733fe05f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc7fcf2-2523-481b-804b-56f23bc81195),volume_type_id=0cc7fcf2-2523-481b-804b-56f23bc81195)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac662434-ac30-4e98-ae46-c115741caae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac662434-ac30-4e98-ae46-c115741caae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15972386-65e6-4009-af64-eb01801b5c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15972386-65e6-4009-af64-eb01801b5c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6520d0c3-c0f6-49f3-bef1-be75babd0e56', 'volume_name': 'volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e45196-e867-4701-9e08-de6c5937ae24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e45196-e867-4701-9e08-de6c5937ae24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bdc1c4-fac3-4c7a-a68e-510e7d2a449b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:52 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Volume 6520d0c3-c0f6-49f3-bef1-be75babd0e56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56', 'volume_size': 1}
Jul 03 13:10:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4176c224-893c-4142-b35f-1dcde0650813,created_at=2026-07-03T11:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-184166441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4176c224-893c-4142-b35f-1dcde0650813,host='devstack@QuobyteHD#QuobyteHD',id=6520d0c3-c0f6-49f3-bef1-be75babd0e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8daf00869e5e4d5c8cc41a4944a1ba74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:52Z,use_quota=True,user_id='c4641d2d1f664720a26d852b733fe05f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc7fcf2-2523-481b-804b-56f23bc81195),volume_type_id=0cc7fcf2-2523-481b-804b-56f23bc81195)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:10:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Creating volume 6520d0c3-c0f6-49f3-bef1-be75babd0e56 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:10:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:10:52 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:10:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:52 devstack sudo[98757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56 1073741824
Jul 03 13:10:52 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:52 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-617af46b-87db-4b6d-8688-34d56b60dc9a req-249dac8b-f41f-4eb1-aea0-a58731944c57 tempest-AttachVolumeTestJSON-933021987 None] Terminate volume connection completed successfully.
Jul 03 13:10:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-617af46b-87db-4b6d-8688-34d56b60dc9a req-249dac8b-f41f-4eb1-aea0-a58731944c57 tempest-AttachVolumeTestJSON-933021987 None] Deleting attachment b39d98b0-55e2-4796-a752-49992d87e582. {{(pid=86837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:10:52 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cbde7724-9271-415c-b472-970ad9493697 tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25b99f36-e5b8-4fb7-a44c-241a672b75dc" returned: 0 in 0.973s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:53 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cbde7724-9271-415c-b472-970ad9493697 tempest-VolumesGetTest-1922388409 None] Lock "cinder-quobyte-25b99f36-e5b8-4fb7-a44c-241a672b75dc" released by "delete_volume" :: held 2.073s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:53 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-cbde7724-9271-415c-b472-970ad9493697 tempest-VolumesGetTest-1922388409 None] Created reservations ['f26c0e3c-9754-4d05-87a3-5af349d4f63b', 'cb706e5b-0bba-49c8-8661-17304b802e83', 'c413757f-6eea-45a1-9fcb-15461b9e60fd', '273a19e5-f460-42b6-900f-457adde8d970'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:10:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cbde7724-9271-415c-b472-970ad9493697 tempest-VolumesGetTest-1922388409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cbde7724-9271-415c-b472-970ad9493697 tempest-VolumesGetTest-1922388409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:53 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-cbde7724-9271-415c-b472-970ad9493697 tempest-VolumesGetTest-1922388409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:53 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-cbde7724-9271-415c-b472-970ad9493697 tempest-VolumesGetTest-1922388409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cbde7724-9271-415c-b472-970ad9493697 tempest-VolumesGetTest-1922388409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cbde7724-9271-415c-b472-970ad9493697 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:53 devstack sudo[98761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:10:53 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:53 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56 1073741824" returned: 0 in 1.229s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:54 devstack sudo[98767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56
Jul 03 13:10:54 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:54 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cbde7724-9271-415c-b472-970ad9493697 tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.194s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:54 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-cbde7724-9271-415c-b472-970ad9493697 tempest-VolumesGetTest-1922388409 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:10:54 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-cbde7724-9271-415c-b472-970ad9493697 tempest-VolumesGetTest-1922388409 None] Deleted volume successfully.
Jul 03 13:10:54 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cbde7724-9271-415c-b472-970ad9493697 tempest-VolumesGetTest-1922388409 None] Lock "cinder-25b99f36-e5b8-4fb7-a44c-241a672b75dc-delete_volume" released by "delete_volume" :: held 3.739s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Flow 'volume_create_manager' (fc33e064-c4a2-4d08-9821-0deb7d1d577e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ec6fec-0890-44da-9fa7-3911a3f78582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:55 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ec6fec-0890-44da-9fa7-3911a3f78582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1283020579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693ab3f0-09a1-46de-82aa-981b36fc6de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41f3d519e48d44dfa81cc5bd48f8acee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:55Z,use_quota=True,user_id='97064b55755d41f1849fde163b43474a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af638e7e-8a90-4bf3-b271-8bb051bd98af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af638e7e-8a90-4bf3-b271-8bb051bd98af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d00c1e5-3989-4723-abde-f12f54e0fc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d00c1e5-3989-4723-abde-f12f54e0fc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '693ab3f0-09a1-46de-82aa-981b36fc6de5', 'volume_name': 'volume-693ab3f0-09a1-46de-82aa-981b36fc6de5', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec4c452c-e9cb-464b-8fe6-a77a5530c0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec4c452c-e9cb-464b-8fe6-a77a5530c0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4611ffaa-372d-4697-aa12-0aa67dd6a0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:55 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Volume 693ab3f0-09a1-46de-82aa-981b36fc6de5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-693ab3f0-09a1-46de-82aa-981b36fc6de5', 'volume_size': 1}
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56" returned: 0 in 1.357s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] <== create_volume: return (2651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.654s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1283020579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693ab3f0-09a1-46de-82aa-981b36fc6de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41f3d519e48d44dfa81cc5bd48f8acee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:55Z,use_quota=True,user_id='97064b55755d41f1849fde163b43474a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Creating volume 693ab3f0-09a1-46de-82aa-981b36fc6de5 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:10:55 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:55 devstack sudo[98778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5 1073741824
Jul 03 13:10:55 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bdc1c4-fac3-4c7a-a68e-510e7d2a449b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808ac311-da3c-458a-adfb-97cda4be9b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:55 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Volume volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56 (6520d0c3-c0f6-49f3-bef1-be75babd0e56): created successfully
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808ac311-da3c-458a-adfb-97cda4be9b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Flow 'volume_create_manager' (e3980363-b8d4-468d-8009-9c2094bdf5db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:55 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-d9d4c647-0a2b-4da3-bb43-b6435d36940b tempest-GroupsV314Test-1779044300 None] Created volume successfully.
Jul 03 13:10:56 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5 1073741824" returned: 0 in 1.069s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:56 devstack sudo[98784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5
Jul 03 13:10:56 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:57 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5" returned: 0 in 1.246s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] <== create_volume: return (2386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:10:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.389s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:10:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4611ffaa-372d-4697-aa12-0aa67dd6a0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-693ab3f0-09a1-46de-82aa-981b36fc6de5', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa56333-68b2-4ccd-ad00-3f7f22bb279b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:57 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Volume volume-693ab3f0-09a1-46de-82aa-981b36fc6de5 (693ab3f0-09a1-46de-82aa-981b36fc6de5): created successfully
Jul 03 13:10:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa56333-68b2-4ccd-ad00-3f7f22bb279b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Flow 'volume_create_manager' (fc33e064-c4a2-4d08-9821-0deb7d1d577e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:57 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-82f0df9f-df07-497e-a447-03444e43ab65 tempest-VolumesGetTest-1922388409 None] Created volume successfully.
Jul 03 13:10:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:10:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:10:57 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Cloning volume 6520d0c3-c0f6-49f3-bef1-be75babd0e56 to volume fa4e9745-804b-4a68-8959-6ef9b5e9eb15
Jul 03 13:10:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Creating offline snapshot 873f75ea-f072-4c54-8eca-5dff1a800463 of volume 6520d0c3-c0f6-49f3-bef1-be75babd0e56 {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:10:58 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[842da4e7-8a76-4410-9a0c-74ff13a8959b]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:10:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:58 devstack sudo[98869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56
Jul 03 13:10:58 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:59 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root
Jul 03 13:10:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56" returned: 0 in 1.117s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:10:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.873f75ea-f072-4c54-8eca-5dff1a800463 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:10:59 devstack sudo[98880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.873f75ea-f072-4c54-8eca-5dff1a800463 1G
Jul 03 13:10:59 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:10:59 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:10:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Flow 'volume_create_manager' (389b46db-854a-485e-8dbd-3f13b57619a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:10:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e12028-a3c7-42be-9bad-f09ce167fcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e12028-a3c7-42be-9bad-f09ce167fcb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1651316390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e413be3-aa39-44d7-9733-1c4fe1ce5365,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='41f3d519e48d44dfa81cc5bd48f8acee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=693ab3f0-09a1-46de-82aa-981b36fc6de5,status='creating',terminated_at=None,updated_at=2026-07-03T11:10:59Z,use_quota=True,user_id='97064b55755d41f1849fde163b43474a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d98a3c5-ffc6-4214-b1f6-ceb9abefbd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d98a3c5-ffc6-4214-b1f6-ceb9abefbd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e1963b7-18d5-45c4-bd4c-bcc1a5380755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e1963b7-18d5-45c4-bd4c-bcc1a5380755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1e413be3-aa39-44d7-9733-1c4fe1ce5365', 'volume_name': 'volume-1e413be3-aa39-44d7-9733-1c4fe1ce5365', 'volume_size': 1, 'source_volid': '693ab3f0-09a1-46de-82aa-981b36fc6de5', 'source_volstatus': 'available'}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b588e4f6-40ff-4e34-ab3d-0b3931711af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b588e4f6-40ff-4e34-ab3d-0b3931711af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:10:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f795be32-f66e-4a0d-add1-e4d733730c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:10:59 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Volume 1e413be3-aa39-44d7-9733-1c4fe1ce5365: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1e413be3-aa39-44d7-9733-1c4fe1ce5365', 'volume_size': 1, 'source_volid': '693ab3f0-09a1-46de-82aa-981b36fc6de5', 'source_volstatus': 'available'}
Jul 03 13:10:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:00 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.873f75ea-f072-4c54-8eca-5dff1a800463 1G" returned: 0 in 1.188s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.873f75ea-f072-4c54-8eca-5dff1a800463 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:00 devstack sudo[98889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.873f75ea-f072-4c54-8eca-5dff1a800463
Jul 03 13:11:00 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:01 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.873f75ea-f072-4c54-8eca-5dff1a800463" returned: 0 in 0.923s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:01 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.873f75ea-f072-4c54-8eca-5dff1a800463 is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 13:11:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.873f75ea-f072-4c54-8eca-5dff1a800463 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:01 devstack sudo[98895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.873f75ea-f072-4c54-8eca-5dff1a800463
Jul 03 13:11:01 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:02 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.873f75ea-f072-4c54-8eca-5dff1a800463" returned: 0 in 0.844s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:02 devstack sudo[98899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.info
Jul 03 13:11:02 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:02 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.info" returned: 0 in 0.700s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:02 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 13:11:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:02 devstack sudo[98903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.info
Jul 03 13:11:02 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:03 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.info" returned: 0 in 0.915s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:03 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Acquiring lock "cinder-quobyte-fa4e9745-804b-4a68-8959-6ef9b5e9eb15" by "_copy_volume_from_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:11:03 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Lock "cinder-quobyte-fa4e9745-804b-4a68-8959-6ef9b5e9eb15" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:11:03 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] snapshot: 873f75ea-f072-4c54-8eca-5dff1a800463, volume: fa4e9745-804b-4a68-8959-6ef9b5e9eb15,  {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 13:11:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:03 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:11:03 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:11:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:03 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef34ca41-b364-4f90-8e54-4e1d20b607ec]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.873f75ea-f072-4c54-8eca-5dff1a800463 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:03 devstack sudo[98906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.873f75ea-f072-4c54-8eca-5dff1a800463
Jul 03 13:11:03 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:05 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.873f75ea-f072-4c54-8eca-5dff1a800463" returned: 0 in 1.175s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:05 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:11:05 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56 {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 13:11:05 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Creating direct copy from snapshot {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 13:11:05 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-927ccf54-d5df-4040-8f51-8f535161bdc3 tempest-AttachVolumeTestJSON-933021987 None] Acquiring lock "cinder-7cb656c5-0bff-40d1-b657-9ca28eecfd5e-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:11:05 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d20cd7-2886-4634-8c51-c9134bee0dc2]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:05 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-927ccf54-d5df-4040-8f51-8f535161bdc3 tempest-AttachVolumeTestJSON-933021987 None] Lock "cinder-7cb656c5-0bff-40d1-b657-9ca28eecfd5e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:11:05 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-927ccf54-d5df-4040-8f51-8f535161bdc3 tempest-AttachVolumeTestJSON-933021987 None] Acquiring lock "cinder-quobyte-7cb656c5-0bff-40d1-b657-9ca28eecfd5e" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:11:05 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-927ccf54-d5df-4040-8f51-8f535161bdc3 tempest-AttachVolumeTestJSON-933021987 None] Lock "cinder-quobyte-7cb656c5-0bff-40d1-b657-9ca28eecfd5e" acquired by "delete_volume" :: waited 0.018s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:11:05 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b6173f-82fe-4117-b2d8-edc7e3a5edb8]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-927ccf54-d5df-4040-8f51-8f535161bdc3 tempest-AttachVolumeTestJSON-933021987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7cb656c5-0bff-40d1-b657-9ca28eecfd5e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:05 devstack sudo[98911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56
Jul 03 13:11:05 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:05 devstack sudo[98912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7cb656c5-0bff-40d1-b657-9ca28eecfd5e
Jul 03 13:11:05 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:05 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56" returned: 0 in 0.938s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:06 devstack cinder-volume[86837]: DEBUG cinder.utils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Path /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fa4e9745-804b-4a68-8959-6ef9b5e9eb15 not found in is_blk_device check {{(pid=86837) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 13:11:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fa4e9745-804b-4a68-8959-6ef9b5e9eb15 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:06 devstack sudo[98919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fa4e9745-804b-4a68-8959-6ef9b5e9eb15
Jul 03 13:11:06 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:06 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-927ccf54-d5df-4040-8f51-8f535161bdc3 tempest-AttachVolumeTestJSON-933021987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7cb656c5-0bff-40d1-b657-9ca28eecfd5e" returned: 0 in 0.987s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-927ccf54-d5df-4040-8f51-8f535161bdc3 tempest-AttachVolumeTestJSON-933021987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7cb656c5-0bff-40d1-b657-9ca28eecfd5e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:06 devstack sudo[98923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7cb656c5-0bff-40d1-b657-9ca28eecfd5e
Jul 03 13:11:06 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:07 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-927ccf54-d5df-4040-8f51-8f535161bdc3 tempest-AttachVolumeTestJSON-933021987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7cb656c5-0bff-40d1-b657-9ca28eecfd5e" returned: 0 in 0.890s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-927ccf54-d5df-4040-8f51-8f535161bdc3 tempest-AttachVolumeTestJSON-933021987 None] Lock "cinder-quobyte-7cb656c5-0bff-40d1-b657-9ca28eecfd5e" released by "delete_volume" :: held 1.968s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:11:07 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-927ccf54-d5df-4040-8f51-8f535161bdc3 tempest-AttachVolumeTestJSON-933021987 None] Created reservations ['c530c4a7-cb32-4c5b-9d27-96d5ccb462f8', '7890f92a-9e8b-46d7-8be3-0f0b02f7c523', 'db15b0ab-2e52-4a41-b6a2-feabc4590fac', '911ad884-9d15-457e-8116-65ce507aba25'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:11:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-927ccf54-d5df-4040-8f51-8f535161bdc3 tempest-AttachVolumeTestJSON-933021987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-927ccf54-d5df-4040-8f51-8f535161bdc3 tempest-AttachVolumeTestJSON-933021987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:07 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-927ccf54-d5df-4040-8f51-8f535161bdc3 tempest-AttachVolumeTestJSON-933021987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:11:07 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-927ccf54-d5df-4040-8f51-8f535161bdc3 tempest-AttachVolumeTestJSON-933021987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:11:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-927ccf54-d5df-4040-8f51-8f535161bdc3 tempest-AttachVolumeTestJSON-933021987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-927ccf54-d5df-4040-8f51-8f535161bdc3 tempest-AttachVolumeTestJSON-933021987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:07 devstack sudo[98936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:11:07 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-09cea2dd-33d2-43e9-92e9-a38297312d52 tempest-AttachVolumeTestJSON-933021987 None] Acquiring lock "cinder-4b1af832-4df9-4257-8782-f81764370c12-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:11:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-09cea2dd-33d2-43e9-92e9-a38297312d52 tempest-AttachVolumeTestJSON-933021987 None] Lock "cinder-4b1af832-4df9-4257-8782-f81764370c12-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:11:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-09cea2dd-33d2-43e9-92e9-a38297312d52 tempest-AttachVolumeTestJSON-933021987 None] Acquiring lock "cinder-quobyte-4b1af832-4df9-4257-8782-f81764370c12" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:11:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-09cea2dd-33d2-43e9-92e9-a38297312d52 tempest-AttachVolumeTestJSON-933021987 None] Lock "cinder-quobyte-4b1af832-4df9-4257-8782-f81764370c12" acquired by "delete_volume" :: waited 0.055s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:11:08 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3459c60d-1c54-4964-ad08-6f38e0cc3749]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-09cea2dd-33d2-43e9-92e9-a38297312d52 tempest-AttachVolumeTestJSON-933021987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4b1af832-4df9-4257-8782-f81764370c12 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:08 devstack sudo[98938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4b1af832-4df9-4257-8782-f81764370c12
Jul 03 13:11:08 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:09 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-927ccf54-d5df-4040-8f51-8f535161bdc3 tempest-AttachVolumeTestJSON-933021987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.703s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:09 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-927ccf54-d5df-4040-8f51-8f535161bdc3 tempest-AttachVolumeTestJSON-933021987 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:11:09 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-927ccf54-d5df-4040-8f51-8f535161bdc3 tempest-AttachVolumeTestJSON-933021987 None] Deleted volume successfully.
Jul 03 13:11:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-927ccf54-d5df-4040-8f51-8f535161bdc3 tempest-AttachVolumeTestJSON-933021987 None] Lock "cinder-7cb656c5-0bff-40d1-b657-9ca28eecfd5e-delete_volume" released by "delete_volume" :: held 4.247s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:11:10 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-09cea2dd-33d2-43e9-92e9-a38297312d52 tempest-AttachVolumeTestJSON-933021987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4b1af832-4df9-4257-8782-f81764370c12" returned: 0 in 2.884s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-09cea2dd-33d2-43e9-92e9-a38297312d52 tempest-AttachVolumeTestJSON-933021987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4b1af832-4df9-4257-8782-f81764370c12 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:11 devstack sudo[98944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4b1af832-4df9-4257-8782-f81764370c12
Jul 03 13:11:11 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:12 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-09cea2dd-33d2-43e9-92e9-a38297312d52 tempest-AttachVolumeTestJSON-933021987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4b1af832-4df9-4257-8782-f81764370c12" returned: 0 in 1.572s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-09cea2dd-33d2-43e9-92e9-a38297312d52 tempest-AttachVolumeTestJSON-933021987 None] Lock "cinder-quobyte-4b1af832-4df9-4257-8782-f81764370c12" released by "delete_volume" :: held 4.584s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:11:12 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-09cea2dd-33d2-43e9-92e9-a38297312d52 tempest-AttachVolumeTestJSON-933021987 None] Created reservations ['ca56e60d-e21e-486f-b98b-203e7d80bd76', '6d7e8418-3716-4898-97b4-eeca8de617d1', '8fa74384-97d7-436c-9587-3aca8e0c3008', '27f8e3c8-6a36-43a6-9f23-d62194a9e488'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:11:12 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fa4e9745-804b-4a68-8959-6ef9b5e9eb15" returned: 0 in 6.696s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-09cea2dd-33d2-43e9-92e9-a38297312d52 tempest-AttachVolumeTestJSON-933021987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-09cea2dd-33d2-43e9-92e9-a38297312d52 tempest-AttachVolumeTestJSON-933021987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:12 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-09cea2dd-33d2-43e9-92e9-a38297312d52 tempest-AttachVolumeTestJSON-933021987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:11:12 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-09cea2dd-33d2-43e9-92e9-a38297312d52 tempest-AttachVolumeTestJSON-933021987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:11:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-09cea2dd-33d2-43e9-92e9-a38297312d52 tempest-AttachVolumeTestJSON-933021987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-09cea2dd-33d2-43e9-92e9-a38297312d52 tempest-AttachVolumeTestJSON-933021987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:12 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd03d65e-4b84-490c-9c35-fe58c3a4f6dd]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:12 devstack sudo[98949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:11:12 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:12 devstack sudo[98950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56
Jul 03 13:11:12 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-da7451e3-a123-401b-8084-14d5ce18ac06 tempest-AttachVolumeTestJSON-933021987 None] Acquiring lock "cinder-783c0a8d-6179-4abd-b50d-bbb69259fd2f-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:11:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-da7451e3-a123-401b-8084-14d5ce18ac06 tempest-AttachVolumeTestJSON-933021987 None] Lock "cinder-783c0a8d-6179-4abd-b50d-bbb69259fd2f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:11:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-da7451e3-a123-401b-8084-14d5ce18ac06 tempest-AttachVolumeTestJSON-933021987 None] Acquiring lock "cinder-quobyte-783c0a8d-6179-4abd-b50d-bbb69259fd2f" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:11:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-da7451e3-a123-401b-8084-14d5ce18ac06 tempest-AttachVolumeTestJSON-933021987 None] Lock "cinder-quobyte-783c0a8d-6179-4abd-b50d-bbb69259fd2f" acquired by "delete_volume" :: waited 0.035s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:11:13 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7acf03-1520-4c56-be24-f89117a341e4]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-da7451e3-a123-401b-8084-14d5ce18ac06 tempest-AttachVolumeTestJSON-933021987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-783c0a8d-6179-4abd-b50d-bbb69259fd2f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:13 devstack sudo[98953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-783c0a8d-6179-4abd-b50d-bbb69259fd2f
Jul 03 13:11:13 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:13 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-09cea2dd-33d2-43e9-92e9-a38297312d52 tempest-AttachVolumeTestJSON-933021987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.983s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:13 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-09cea2dd-33d2-43e9-92e9-a38297312d52 tempest-AttachVolumeTestJSON-933021987 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:11:13 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-09cea2dd-33d2-43e9-92e9-a38297312d52 tempest-AttachVolumeTestJSON-933021987 None] Deleted volume successfully.
Jul 03 13:11:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-09cea2dd-33d2-43e9-92e9-a38297312d52 tempest-AttachVolumeTestJSON-933021987 None] Lock "cinder-4b1af832-4df9-4257-8782-f81764370c12-delete_volume" released by "delete_volume" :: held 5.964s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:11:14 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56" returned: 0 in 1.492s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:14 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56, size 1024.00 MB, duration 6.70 sec, destination /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fa4e9745-804b-4a68-8959-6ef9b5e9eb15 {{(pid=86837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 13:11:14 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Converted 1024.00 MB image at 152.88 MB/s
Jul 03 13:11:14 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fa4e9745-804b-4a68-8959-6ef9b5e9eb15 is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 13:11:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fa4e9745-804b-4a68-8959-6ef9b5e9eb15 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:14 devstack sudo[98963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fa4e9745-804b-4a68-8959-6ef9b5e9eb15
Jul 03 13:11:14 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:14 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-da7451e3-a123-401b-8084-14d5ce18ac06 tempest-AttachVolumeTestJSON-933021987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-783c0a8d-6179-4abd-b50d-bbb69259fd2f" returned: 0 in 1.033s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-da7451e3-a123-401b-8084-14d5ce18ac06 tempest-AttachVolumeTestJSON-933021987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-783c0a8d-6179-4abd-b50d-bbb69259fd2f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:14 devstack sudo[98965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-783c0a8d-6179-4abd-b50d-bbb69259fd2f
Jul 03 13:11:14 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:14 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fa4e9745-804b-4a68-8959-6ef9b5e9eb15" returned: 0 in 0.707s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Lock "cinder-quobyte-fa4e9745-804b-4a68-8959-6ef9b5e9eb15" released by "_copy_volume_from_snapshot" :: held 11.156s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:11:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:11:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:11:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:11:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Acquiring lock "cinder-quobyte-873f75ea-f072-4c54-8eca-5dff1a800463" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:11:14 devstack sudo[98969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:11:14 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:15 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Lock "cinder-quobyte-873f75ea-f072-4c54-8eca-5dff1a800463" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:11:15 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Deleting offline snapshot 873f75ea-f072-4c54-8eca-5dff1a800463 of volume 6520d0c3-c0f6-49f3-bef1-be75babd0e56 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:11:15 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] snapshot_file for this snap is: volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.873f75ea-f072-4c54-8eca-5dff1a800463 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:11:15 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[62db3add-b3ee-4e13-83af-6c0d42ede2ea]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.873f75ea-f072-4c54-8eca-5dff1a800463 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:15 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-da7451e3-a123-401b-8084-14d5ce18ac06 tempest-AttachVolumeTestJSON-933021987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-783c0a8d-6179-4abd-b50d-bbb69259fd2f" returned: 0 in 0.804s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:15 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-da7451e3-a123-401b-8084-14d5ce18ac06 tempest-AttachVolumeTestJSON-933021987 None] Lock "cinder-quobyte-783c0a8d-6179-4abd-b50d-bbb69259fd2f" released by "delete_volume" :: held 1.931s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:11:15 devstack sudo[98971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.873f75ea-f072-4c54-8eca-5dff1a800463
Jul 03 13:11:15 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:15 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-da7451e3-a123-401b-8084-14d5ce18ac06 tempest-AttachVolumeTestJSON-933021987 None] Created reservations ['fdd5553a-29c4-4ab4-99f6-3e3d87fa578e', 'b9fb05be-3a33-4dae-b92a-8dcb0fcfdd4e', '79f4679c-a992-453f-8b58-f64e13f2a228', 'b280de0c-197a-4df1-93c6-96eacb43adba'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:11:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-da7451e3-a123-401b-8084-14d5ce18ac06 tempest-AttachVolumeTestJSON-933021987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-da7451e3-a123-401b-8084-14d5ce18ac06 tempest-AttachVolumeTestJSON-933021987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:15 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-da7451e3-a123-401b-8084-14d5ce18ac06 tempest-AttachVolumeTestJSON-933021987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:11:15 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-da7451e3-a123-401b-8084-14d5ce18ac06 tempest-AttachVolumeTestJSON-933021987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:11:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-da7451e3-a123-401b-8084-14d5ce18ac06 tempest-AttachVolumeTestJSON-933021987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-da7451e3-a123-401b-8084-14d5ce18ac06 tempest-AttachVolumeTestJSON-933021987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:15 devstack sudo[98973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:11:15 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:15 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:11:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Flow 'volume_create_manager' (860b2d5a-7936-4787-8cca-dc59b5c3a3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:11:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd31c0b-1793-4c15-9ed7-3549cc5a6b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd31c0b-1793-4c15-9ed7-3549cc5a6b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1024292377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b79a258a0a40a5a43edf42dd14cc4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:11:15Z,use_quota=True,user_id='b7198d7fc5ca4efb8e06fb44d1a46165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4854f9d-574b-422f-8798-b8cd02075324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4854f9d-574b-422f-8798-b8cd02075324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d554bf8a-390f-4c12-8cb3-4577438d4039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d554bf8a-390f-4c12-8cb3-4577438d4039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d', 'volume_name': 'volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf75b1c-3e58-4f4d-a939-618ce5fc0fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf75b1c-3e58-4f4d-a939-618ce5fc0fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8981e989-2581-453f-b91d-fcb641dc5662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:15 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Volume 6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d', 'volume_size': 1}
Jul 03 13:11:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:16 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.078s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:16 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:11:16 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:11:16 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 28 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:11:16 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>, <Thread(tpool_thread_0, started daemon 134850092431040)>, <Thread(tpool_thread_1, started daemon 134850084021952)>, <Thread(tpool_thread_2, started daemon 134850075612864)>, <Thread(tpool_thread_3, started daemon 134850067203776)>, <Thread(tpool_thread_4, started daemon 134850058794688)>, <Thread(tpool_thread_5, started daemon 134850050385600)>, <Thread(tpool_thread_6, started daemon 134850041976512)>, <Thread(tpool_thread_7, started daemon 134850033567424)>, <Thread(tpool_thread_8, started daemon 134850025158336)>, <Thread(tpool_thread_9, started daemon 134850016749248)>, <Thread(tpool_thread_10, started daemon 134850008340160)>, <Thread(tpool_thread_11, started daemon 134849999931072)>, <Thread(tpool_thread_12, started daemon 134849991521984)>, <Thread(tpool_thread_13, started daemon 134849983112896)>, <Thread(tpool_thread_14, started daemon 134849974703808)>, <Thread(tpool_thread_15, started daemon 134849966294720)>, <Thread(tpool_thread_16, started daemon 134849957885632)>, <Thread(tpool_thread_17, started daemon 134849949476544)>, <Thread(tpool_thread_18, started daemon 134849941067456)>, <Thread(tpool_thread_19, started daemon 134849932658368)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:11:16 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.873f75ea-f072-4c54-8eca-5dff1a800463" returned: 0 in 1.018s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:16 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:11:16 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cd684b-596e-4108-be6c-1c6da1922d5d]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:16 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-da7451e3-a123-401b-8084-14d5ce18ac06 tempest-AttachVolumeTestJSON-933021987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.875s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:16 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-da7451e3-a123-401b-8084-14d5ce18ac06 tempest-AttachVolumeTestJSON-933021987 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:11:16 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-da7451e3-a123-401b-8084-14d5ce18ac06 tempest-AttachVolumeTestJSON-933021987 None] Deleted volume successfully.
Jul 03 13:11:16 devstack sudo[98981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56
Jul 03 13:11:16 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:16 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-da7451e3-a123-401b-8084-14d5ce18ac06 tempest-AttachVolumeTestJSON-933021987 None] Lock "cinder-783c0a8d-6179-4abd-b50d-bbb69259fd2f-delete_volume" released by "delete_volume" :: held 3.143s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:11:17 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56" returned: 0 in 0.948s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.873f75ea-f072-4c54-8eca-5dff1a800463 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:17 devstack sudo[98986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.873f75ea-f072-4c54-8eca-5dff1a800463
Jul 03 13:11:17 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:17 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.873f75ea-f072-4c54-8eca-5dff1a800463" returned: 0 in 0.915s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.873f75ea-f072-4c54-8eca-5dff1a800463 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:18 devstack sudo[99029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.873f75ea-f072-4c54-8eca-5dff1a800463
Jul 03 13:11:18 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:18 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56.873f75ea-f072-4c54-8eca-5dff1a800463" returned: 0 in 0.800s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:18 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Lock "cinder-quobyte-873f75ea-f072-4c54-8eca-5dff1a800463" released by "_delete_snapshot" :: held 3.814s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:11:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.958s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 19.343s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:18 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Cloning volume 693ab3f0-09a1-46de-82aa-981b36fc6de5 to volume 1e413be3-aa39-44d7-9733-1c4fe1ce5365
Jul 03 13:11:18 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Creating offline snapshot 3bd531f5-95a9-4fc6-98f1-b3c790f77c0a of volume 693ab3f0-09a1-46de-82aa-981b36fc6de5 {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:11:18 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abecef4-f43b-48f2-a9f6-bc84c1b5210a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:18 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-59935683-447e-40bd-8d85-d552097ae837 tempest-GroupsV314Test-1779044300 None] Create group from source-group-4176c224-893c-4142-b35f-1dcde0650813 completed successfully.
Jul 03 13:11:19 devstack sudo[99032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5
Jul 03 13:11:19 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:19 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0691fd2e-571e-4405-8995-f85b388a17e4 tempest-GroupsV314Test-1779044300 None] Acquiring lock "cinder-quobyte-fa4e9745-804b-4a68-8959-6ef9b5e9eb15" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:11:19 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0691fd2e-571e-4405-8995-f85b388a17e4 tempest-GroupsV314Test-1779044300 None] Lock "cinder-quobyte-fa4e9745-804b-4a68-8959-6ef9b5e9eb15" acquired by "delete_volume" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:11:19 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[0856ed1e-dc94-47c7-b6a0-35cae9a86f33]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0691fd2e-571e-4405-8995-f85b388a17e4 tempest-GroupsV314Test-1779044300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fa4e9745-804b-4a68-8959-6ef9b5e9eb15 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:19 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5" returned: 0 in 0.958s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.3bd531f5-95a9-4fc6-98f1-b3c790f77c0a 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:19 devstack sudo[99038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.3bd531f5-95a9-4fc6-98f1-b3c790f77c0a 1G
Jul 03 13:11:19 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:20 devstack sudo[99037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fa4e9745-804b-4a68-8959-6ef9b5e9eb15
Jul 03 13:11:20 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:21 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0691fd2e-571e-4405-8995-f85b388a17e4 tempest-GroupsV314Test-1779044300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fa4e9745-804b-4a68-8959-6ef9b5e9eb15" returned: 0 in 1.119s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0691fd2e-571e-4405-8995-f85b388a17e4 tempest-GroupsV314Test-1779044300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fa4e9745-804b-4a68-8959-6ef9b5e9eb15 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:21 devstack sudo[99047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fa4e9745-804b-4a68-8959-6ef9b5e9eb15
Jul 03 13:11:21 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:21 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.3bd531f5-95a9-4fc6-98f1-b3c790f77c0a 1G" returned: 0 in 1.273s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-693ab3f0-09a1-46de-82aa-981b36fc6de5 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.3bd531f5-95a9-4fc6-98f1-b3c790f77c0a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:21 devstack sudo[99050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-693ab3f0-09a1-46de-82aa-981b36fc6de5 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.3bd531f5-95a9-4fc6-98f1-b3c790f77c0a
Jul 03 13:11:21 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:21 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0691fd2e-571e-4405-8995-f85b388a17e4 tempest-GroupsV314Test-1779044300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fa4e9745-804b-4a68-8959-6ef9b5e9eb15" returned: 0 in 0.834s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:21 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0691fd2e-571e-4405-8995-f85b388a17e4 tempest-GroupsV314Test-1779044300 None] Lock "cinder-quobyte-fa4e9745-804b-4a68-8959-6ef9b5e9eb15" released by "delete_volume" :: held 2.021s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:11:21 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-0691fd2e-571e-4405-8995-f85b388a17e4 tempest-GroupsV314Test-1779044300 None] Created reservations ['52d07c5c-4cd6-4670-b02e-d7241aa006ca'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:11:22 devstack cinder-volume[86837]: WARNING cinder.quota [None req-0691fd2e-571e-4405-8995-f85b388a17e4 tempest-GroupsV314Test-1779044300 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-158664036 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-158664036, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:11:22 devstack cinder-volume[86837]: WARNING cinder.quota [None req-0691fd2e-571e-4405-8995-f85b388a17e4 tempest-GroupsV314Test-1779044300 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-158664036 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-158664036, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:11:22 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-0691fd2e-571e-4405-8995-f85b388a17e4 tempest-GroupsV314Test-1779044300 None] Created reservations ['6aa62db7-0eac-4291-a115-e236762e2e2a', '06416dfa-15ab-47bb-b417-4b28c1757177', '91605da6-cd5d-4857-9246-9e67e439e337', '9897607a-fb5a-4483-9a3e-6065ac6de122'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:11:22 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-693ab3f0-09a1-46de-82aa-981b36fc6de5 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.3bd531f5-95a9-4fc6-98f1-b3c790f77c0a" returned: 0 in 0.980s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:22 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.3bd531f5-95a9-4fc6-98f1-b3c790f77c0a is being set with open permissions: ugo+rw
Jul 03 13:11:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.3bd531f5-95a9-4fc6-98f1-b3c790f77c0a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:22 devstack sudo[99057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.3bd531f5-95a9-4fc6-98f1-b3c790f77c0a
Jul 03 13:11:22 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0691fd2e-571e-4405-8995-f85b388a17e4 tempest-GroupsV314Test-1779044300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0691fd2e-571e-4405-8995-f85b388a17e4 tempest-GroupsV314Test-1779044300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:22 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0691fd2e-571e-4405-8995-f85b388a17e4 tempest-GroupsV314Test-1779044300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:11:22 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0691fd2e-571e-4405-8995-f85b388a17e4 tempest-GroupsV314Test-1779044300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:11:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0691fd2e-571e-4405-8995-f85b388a17e4 tempest-GroupsV314Test-1779044300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0691fd2e-571e-4405-8995-f85b388a17e4 tempest-GroupsV314Test-1779044300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:22 devstack sudo[99062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:11:22 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:22 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-abb18247-99c2-4aae-86e6-83074e320b4a tempest-GroupsV314Test-1779044300 None] Acquiring lock "cinder-quobyte-6520d0c3-c0f6-49f3-bef1-be75babd0e56" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:11:22 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-abb18247-99c2-4aae-86e6-83074e320b4a tempest-GroupsV314Test-1779044300 None] Lock "cinder-quobyte-6520d0c3-c0f6-49f3-bef1-be75babd0e56" acquired by "delete_volume" :: waited 0.032s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:11:22 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[751a68b8-2c77-4321-8562-84073bb776f6]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-abb18247-99c2-4aae-86e6-83074e320b4a tempest-GroupsV314Test-1779044300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:22 devstack sudo[99068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56
Jul 03 13:11:22 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:23 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0691fd2e-571e-4405-8995-f85b388a17e4 tempest-GroupsV314Test-1779044300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.951s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:23 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-0691fd2e-571e-4405-8995-f85b388a17e4 tempest-GroupsV314Test-1779044300 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:11:23 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-0691fd2e-571e-4405-8995-f85b388a17e4 tempest-GroupsV314Test-1779044300 None] Delete group completed successfully.
Jul 03 13:11:23 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.3bd531f5-95a9-4fc6-98f1-b3c790f77c0a" returned: 0 in 1.105s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:23 devstack sudo[99072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.info
Jul 03 13:11:23 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:23 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-abb18247-99c2-4aae-86e6-83074e320b4a tempest-GroupsV314Test-1779044300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56" returned: 0 in 0.964s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-abb18247-99c2-4aae-86e6-83074e320b4a tempest-GroupsV314Test-1779044300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:23 devstack sudo[99077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56
Jul 03 13:11:23 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:24 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.info" returned: 0 in 0.960s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:24 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.info is being set with open permissions: ugo+rw
Jul 03 13:11:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:24 devstack sudo[99082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.info
Jul 03 13:11:24 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:24 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-abb18247-99c2-4aae-86e6-83074e320b4a tempest-GroupsV314Test-1779044300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6520d0c3-c0f6-49f3-bef1-be75babd0e56" returned: 0 in 0.912s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-abb18247-99c2-4aae-86e6-83074e320b4a tempest-GroupsV314Test-1779044300 None] Lock "cinder-quobyte-6520d0c3-c0f6-49f3-bef1-be75babd0e56" released by "delete_volume" :: held 1.970s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:11:24 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-abb18247-99c2-4aae-86e6-83074e320b4a tempest-GroupsV314Test-1779044300 None] Created reservations ['bfa7a3c2-2142-475a-8f84-66729152ccdb'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:11:24 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-abb18247-99c2-4aae-86e6-83074e320b4a tempest-GroupsV314Test-1779044300 None] Created reservations ['d9cf72d7-22ad-44d7-9b82-10fff075e4e2', 'f7195fe6-767f-4cc5-9671-3606495f5b91', '36edc163-252b-4bd0-93fe-77ee230d9ced', 'fc3f7f4a-c8f5-44ab-a3a0-308268cb1d48'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:11:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-abb18247-99c2-4aae-86e6-83074e320b4a tempest-GroupsV314Test-1779044300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-abb18247-99c2-4aae-86e6-83074e320b4a tempest-GroupsV314Test-1779044300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-abb18247-99c2-4aae-86e6-83074e320b4a tempest-GroupsV314Test-1779044300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:11:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-abb18247-99c2-4aae-86e6-83074e320b4a tempest-GroupsV314Test-1779044300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:11:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-abb18247-99c2-4aae-86e6-83074e320b4a tempest-GroupsV314Test-1779044300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-abb18247-99c2-4aae-86e6-83074e320b4a tempest-GroupsV314Test-1779044300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:24 devstack sudo[99086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:11:24 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:25 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.info" returned: 0 in 0.875s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Acquiring lock "cinder-quobyte-1e413be3-aa39-44d7-9733-1c4fe1ce5365" by "_copy_volume_from_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:11:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Lock "cinder-quobyte-1e413be3-aa39-44d7-9733-1c4fe1ce5365" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:11:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] snapshot: 3bd531f5-95a9-4fc6-98f1-b3c790f77c0a, volume: 1e413be3-aa39-44d7-9733-1c4fe1ce5365,  {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 13:11:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:11:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:11:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:25 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb17d21-1c5b-4f13-b7f7-cafafc914c5c]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.3bd531f5-95a9-4fc6-98f1-b3c790f77c0a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:25 devstack sudo[99088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.3bd531f5-95a9-4fc6-98f1-b3c790f77c0a
Jul 03 13:11:25 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:25 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-abb18247-99c2-4aae-86e6-83074e320b4a tempest-GroupsV314Test-1779044300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.825s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:25 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-abb18247-99c2-4aae-86e6-83074e320b4a tempest-GroupsV314Test-1779044300 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:11:25 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-abb18247-99c2-4aae-86e6-83074e320b4a tempest-GroupsV314Test-1779044300 None] Delete group completed successfully.
Jul 03 13:11:26 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:11:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Flow 'volume_create_manager' (97fa74bd-f6d5-405a-ab22-6af6b8ed9d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:11:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dbf028f-cbae-4196-91bf-44abb4c3d933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dbf028f-cbae-4196-91bf-44abb4c3d933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-789395004',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de14a686-ba12-4e18-ab9f-317fc4d769ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9c121f868e3e4633870db4ddf8db6dc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:11:26Z,use_quota=True,user_id='f233101b17ad4133b570dae808044486',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d56ffc32-5642-44db-8ba3-b67ed0ad3ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d56ffc32-5642-44db-8ba3-b67ed0ad3ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6267a94-ef8d-4071-ba76-4c98d3874724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6267a94-ef8d-4071-ba76-4c98d3874724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de14a686-ba12-4e18-ab9f-317fc4d769ab', 'volume_name': 'volume-de14a686-ba12-4e18-ab9f-317fc4d769ab', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e368b7e-389e-49d5-abc6-8bfe99549783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e368b7e-389e-49d5-abc6-8bfe99549783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5377ee61-8182-4754-8f00-764db190264f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:26 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Volume de14a686-ba12-4e18-ab9f-317fc4d769ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de14a686-ba12-4e18-ab9f-317fc4d769ab', 'volume_size': 1}
Jul 03 13:11:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:26 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.3bd531f5-95a9-4fc6-98f1-b3c790f77c0a" returned: 0 in 1.168s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-693ab3f0-09a1-46de-82aa-981b36fc6de5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:11:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5 {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 13:11:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Creating direct copy from snapshot {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 13:11:26 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfdc43b-a39b-49a3-8a92-5a753f543b33]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:26 devstack sudo[99094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5
Jul 03 13:11:26 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:27 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5" returned: 0 in 0.934s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:27 devstack cinder-volume[86837]: DEBUG cinder.utils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Path /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1e413be3-aa39-44d7-9733-1c4fe1ce5365 not found in is_blk_device check {{(pid=86837) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 13:11:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1e413be3-aa39-44d7-9733-1c4fe1ce5365 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:27 devstack sudo[99099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1e413be3-aa39-44d7-9733-1c4fe1ce5365
Jul 03 13:11:27 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:33 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1e413be3-aa39-44d7-9733-1c4fe1ce5365" returned: 0 in 5.784s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:33 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8598ab-3793-4552-89dd-b9da737aecb6]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:33 devstack sudo[99113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5
Jul 03 13:11:33 devstack sudo[99113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:33 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:11:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Flow 'volume_create_manager' (6940055d-0b12-4cea-8734-8b2a0bc3bb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:11:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11172e96-1af4-4dfc-b548-00ab59a0db9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11172e96-1af4-4dfc-b548-00ab59a0db9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-323576211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7184d0a-0b90-4316-880f-f2c5125f768d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='517b995f7e02413ab7068d8495ae18f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:11:34Z,use_quota=True,user_id='fb0ea2ab7eab413684e3c4cac8220e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85467dc1-bf84-455b-a281-a3b5fa43eadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85467dc1-bf84-455b-a281-a3b5fa43eadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584675ac-d7cc-4a82-9cd5-cd99a8706c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584675ac-d7cc-4a82-9cd5-cd99a8706c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7184d0a-0b90-4316-880f-f2c5125f768d', 'volume_name': 'volume-e7184d0a-0b90-4316-880f-f2c5125f768d', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a4829ad-ce62-438d-b44a-2b09aab989de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a4829ad-ce62-438d-b44a-2b09aab989de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7a0a0a9-3680-4a63-b10c-800488c41f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:33 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Volume e7184d0a-0b90-4316-880f-f2c5125f768d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7184d0a-0b90-4316-880f-f2c5125f768d', 'volume_size': 1}
Jul 03 13:11:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:34 devstack sudo[99113]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5" returned: 0 in 0.978s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:34 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5, size 1024.00 MB, duration 5.79 sec, destination /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1e413be3-aa39-44d7-9733-1c4fe1ce5365 {{(pid=86837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 13:11:34 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Converted 1024.00 MB image at 176.97 MB/s
Jul 03 13:11:34 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1e413be3-aa39-44d7-9733-1c4fe1ce5365 is being set with open permissions: ugo+rw
Jul 03 13:11:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1e413be3-aa39-44d7-9733-1c4fe1ce5365 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:34 devstack sudo[99118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1e413be3-aa39-44d7-9733-1c4fe1ce5365
Jul 03 13:11:34 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:34 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1e413be3-aa39-44d7-9733-1c4fe1ce5365" returned: 0 in 0.646s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:34 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Lock "cinder-quobyte-1e413be3-aa39-44d7-9733-1c4fe1ce5365" released by "_copy_volume_from_snapshot" :: held 9.623s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:11:34 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Acquiring lock "cinder-quobyte-3bd531f5-95a9-4fc6-98f1-b3c790f77c0a" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:11:34 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Lock "cinder-quobyte-3bd531f5-95a9-4fc6-98f1-b3c790f77c0a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:11:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Deleting offline snapshot 3bd531f5-95a9-4fc6-98f1-b3c790f77c0a of volume 693ab3f0-09a1-46de-82aa-981b36fc6de5 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:11:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] snapshot_file for this snap is: volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.3bd531f5-95a9-4fc6-98f1-b3c790f77c0a {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:11:34 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdba644-d8be-40fd-9855-9d9d4930e885]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.3bd531f5-95a9-4fc6-98f1-b3c790f77c0a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:35 devstack sudo[99121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.3bd531f5-95a9-4fc6-98f1-b3c790f77c0a
Jul 03 13:11:35 devstack sudo[99121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:35 devstack sudo[99121]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.3bd531f5-95a9-4fc6-98f1-b3c790f77c0a" returned: 0 in 0.740s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-693ab3f0-09a1-46de-82aa-981b36fc6de5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:11:35 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[244fa9c5-217c-4d67-99b2-2f83a151520f]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:35 devstack sudo[99126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5
Jul 03 13:11:35 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:36 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5" returned: 0 in 0.738s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.3bd531f5-95a9-4fc6-98f1-b3c790f77c0a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:36 devstack sudo[99131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.3bd531f5-95a9-4fc6-98f1-b3c790f77c0a
Jul 03 13:11:36 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:37 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.3bd531f5-95a9-4fc6-98f1-b3c790f77c0a" returned: 0 in 0.715s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.3bd531f5-95a9-4fc6-98f1-b3c790f77c0a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:37 devstack sudo[99137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.3bd531f5-95a9-4fc6-98f1-b3c790f77c0a
Jul 03 13:11:37 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:37 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5.3bd531f5-95a9-4fc6-98f1-b3c790f77c0a" returned: 0 in 0.648s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:37 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Lock "cinder-quobyte-3bd531f5-95a9-4fc6-98f1-b3c790f77c0a" released by "_delete_snapshot" :: held 2.938s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:11:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.969s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.173s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1024292377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b79a258a0a40a5a43edf42dd14cc4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:11:15Z,use_quota=True,user_id='b7198d7fc5ca4efb8e06fb44d1a46165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:11:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Creating volume 6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:11:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:11:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:11:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:11:37 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:11:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:37 devstack sudo[99140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d 1073741824
Jul 03 13:11:37 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f795be32-f66e-4a0d-add1-e4d733730c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e413be3-aa39-44d7-9733-1c4fe1ce5365', 'volume_size': 1, 'source_volid': '693ab3f0-09a1-46de-82aa-981b36fc6de5', 'source_volstatus': 'available'}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3baf4b54-5672-468d-a0e2-2b2501f0366e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:37 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Volume volume-1e413be3-aa39-44d7-9733-1c4fe1ce5365 (1e413be3-aa39-44d7-9733-1c4fe1ce5365): created successfully
Jul 03 13:11:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3baf4b54-5672-468d-a0e2-2b2501f0366e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Flow 'volume_create_manager' (389b46db-854a-485e-8dbd-3f13b57619a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:11:37 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-fdd9b791-d2c5-47f2-a3d7-e14255c2b9de tempest-VolumesGetTest-1922388409 None] Created volume successfully.
Jul 03 13:11:38 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d 1073741824" returned: 0 in 0.841s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:38 devstack sudo[99146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d
Jul 03 13:11:38 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:39 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d" returned: 0 in 0.733s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.314s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-789395004',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de14a686-ba12-4e18-ab9f-317fc4d769ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9c121f868e3e4633870db4ddf8db6dc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:11:26Z,use_quota=True,user_id='f233101b17ad4133b570dae808044486',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Creating volume de14a686-ba12-4e18-ab9f-317fc4d769ab {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:11:39 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-de14a686-ba12-4e18-ab9f-317fc4d769ab 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8981e989-2581-453f-b91d-fcb641dc5662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c385f2fb-f47d-44cf-bd17-2fe3ba3eb5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:39 devstack sudo[99150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-de14a686-ba12-4e18-ab9f-317fc4d769ab 1073741824
Jul 03 13:11:39 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:39 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Volume volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d (6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d): created successfully
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c385f2fb-f47d-44cf-bd17-2fe3ba3eb5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Flow 'volume_create_manager' (860b2d5a-7936-4787-8cca-dc59b5c3a3da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:11:39 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-ac7dcf79-fa10-4ce3-bd34-c8fabef102ed tempest-SnapshotDependencyTests-1051766090 None] Created volume successfully.
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Flow 'volume_create_manager' (2a1e1c9b-6163-4c94-b873-a1e0c090309d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18196b0f-6111-4558-ba45-d8d922d7eee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18196b0f-6111-4558-ba45-d8d922d7eee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:11:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-298011088',display_name='tempest-VolumesGetTest-Volume-1685579040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a14eb3f-2f32-4183-bf9f-6b2f7bd6986a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41f3d519e48d44dfa81cc5bd48f8acee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:11:40Z,use_quota=True,user_id='97064b55755d41f1849fde163b43474a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29745605-67be-44b5-8f68-421a6d91f170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29745605-67be-44b5-8f68-421a6d91f170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d6e188-454d-4950-91a9-064ecdaf126c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d6e188-454d-4950-91a9-064ecdaf126c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a14eb3f-2f32-4183-bf9f-6b2f7bd6986a', 'volume_name': 'volume-8a14eb3f-2f32-4183-bf9f-6b2f7bd6986a', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faedf5f9-717c-4f27-b370-bb569cbcc14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faedf5f9-717c-4f27-b370-bb569cbcc14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48938365-e4bf-45ae-b8da-b5581de06323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:39 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Volume 8a14eb3f-2f32-4183-bf9f-6b2f7bd6986a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a14eb3f-2f32-4183-bf9f-6b2f7bd6986a', 'volume_size': 1}
Jul 03 13:11:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-643dd184-e934-46c3-b628-55fc16fd12f2 tempest-SnapshotDependencyTests-1051766090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:40 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-de14a686-ba12-4e18-ab9f-317fc4d769ab 1073741824" returned: 0 in 1.012s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-de14a686-ba12-4e18-ab9f-317fc4d769ab {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:40 devstack sudo[99156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-de14a686-ba12-4e18-ab9f-317fc4d769ab
Jul 03 13:11:40 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:41 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-de14a686-ba12-4e18-ab9f-317fc4d769ab" returned: 0 in 0.750s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:11:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.361s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-323576211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7184d0a-0b90-4316-880f-f2c5125f768d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='517b995f7e02413ab7068d8495ae18f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:11:34Z,use_quota=True,user_id='fb0ea2ab7eab413684e3c4cac8220e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:11:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Creating volume e7184d0a-0b90-4316-880f-f2c5125f768d {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:11:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:11:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:11:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:11:41 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:11:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5377ee61-8182-4754-8f00-764db190264f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de14a686-ba12-4e18-ab9f-317fc4d769ab', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:41 devstack sudo[99159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d 1073741824
Jul 03 13:11:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b6251ab-8ee5-40e0-890a-23a842a7ce49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:41 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:41 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Volume volume-de14a686-ba12-4e18-ab9f-317fc4d769ab (de14a686-ba12-4e18-ab9f-317fc4d769ab): created successfully
Jul 03 13:11:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b6251ab-8ee5-40e0-890a-23a842a7ce49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Flow 'volume_create_manager' (97fa74bd-f6d5-405a-ab22-6af6b8ed9d96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:11:41 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-3a8dce08-78f6-4885-8888-2aaef2857b77 tempest-VolumesTestJSON-326027331 None] Created volume successfully.
Jul 03 13:11:42 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d 1073741824" returned: 0 in 0.881s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:42 devstack sudo[99164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d
Jul 03 13:11:42 devstack sudo[99164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:43 devstack sudo[99164]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d" returned: 0 in 0.807s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.144s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:11:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-298011088',display_name='tempest-VolumesGetTest-Volume-1685579040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a14eb3f-2f32-4183-bf9f-6b2f7bd6986a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41f3d519e48d44dfa81cc5bd48f8acee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:11:40Z,use_quota=True,user_id='97064b55755d41f1849fde163b43474a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Creating volume 8a14eb3f-2f32-4183-bf9f-6b2f7bd6986a {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:11:43 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8a14eb3f-2f32-4183-bf9f-6b2f7bd6986a 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:11:43 devstack sudo[99168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8a14eb3f-2f32-4183-bf9f-6b2f7bd6986a 1073741824
Jul 03 13:11:43 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Flow 'volume_create_manager' (f9b11c5e-44a4-4715-8908-08d3047b14dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4008ac6-4de8-41de-a731-0b47f2fb2670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7a0a0a9-3680-4a63-b10c-800488c41f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7184d0a-0b90-4316-880f-f2c5125f768d', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856ac678-683b-4808-981a-b436ce6444a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4008ac6-4de8-41de-a731-0b47f2fb2670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-534156760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d42f25d-9396-447d-96f4-75c624e8c2b5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9c121f868e3e4633870db4ddf8db6dc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:11:43Z,use_quota=True,user_id='f233101b17ad4133b570dae808044486',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af7dc8c5-2fff-48d5-9c6e-1ab75e8f91e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af7dc8c5-2fff-48d5-9c6e-1ab75e8f91e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b641041-f6e6-4fee-9164-4fe4e16e1a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b641041-f6e6-4fee-9164-4fe4e16e1a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d42f25d-9396-447d-96f4-75c624e8c2b5', 'volume_name': 'volume-7d42f25d-9396-447d-96f4-75c624e8c2b5', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72f5b6f7-3005-43e7-bdaa-610e6f82dd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72f5b6f7-3005-43e7-bdaa-610e6f82dd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153c175b-72e5-40af-9f3c-182d9a4ee2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:43 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Volume 7d42f25d-9396-447d-96f4-75c624e8c2b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d42f25d-9396-447d-96f4-75c624e8c2b5', 'volume_size': 1}
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:43 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Volume volume-e7184d0a-0b90-4316-880f-f2c5125f768d (e7184d0a-0b90-4316-880f-f2c5125f768d): created successfully
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856ac678-683b-4808-981a-b436ce6444a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Flow 'volume_create_manager' (6940055d-0b12-4cea-8734-8b2a0bc3bb8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:11:43 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-636ee065-bfe8-4c1e-958c-1316462a61c3 tempest-SnapshotsActionsTest-414207452 None] Created volume successfully.
Jul 03 13:11:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0f183b99-3217-487e-9a16-2fa8113657ef tempest-SnapshotsActionsTest-414207452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:44 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8a14eb3f-2f32-4183-bf9f-6b2f7bd6986a 1073741824" returned: 0 in 1.039s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8a14eb3f-2f32-4183-bf9f-6b2f7bd6986a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:44 devstack sudo[99173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8a14eb3f-2f32-4183-bf9f-6b2f7bd6986a
Jul 03 13:11:44 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:44 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8a14eb3f-2f32-4183-bf9f-6b2f7bd6986a" returned: 0 in 0.718s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:11:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.825s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-643dd184-e934-46c3-b628-55fc16fd12f2 tempest-SnapshotDependencyTests-1051766090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.812s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-643dd184-e934-46c3-b628-55fc16fd12f2 tempest-SnapshotDependencyTests-1051766090 None] Creating offline snapshot b1376335-1b3f-44e4-a498-eacedfae0d3f of volume 6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:11:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48938365-e4bf-45ae-b8da-b5581de06323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a14eb3f-2f32-4183-bf9f-6b2f7bd6986a', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6960843-be12-4303-94b4-f321e0337d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:44 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fa72b8-adbc-430c-9c0c-55505f324bea]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-643dd184-e934-46c3-b628-55fc16fd12f2 tempest-SnapshotDependencyTests-1051766090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:44 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Volume volume-8a14eb3f-2f32-4183-bf9f-6b2f7bd6986a (8a14eb3f-2f32-4183-bf9f-6b2f7bd6986a): created successfully
Jul 03 13:11:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6960843-be12-4303-94b4-f321e0337d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Flow 'volume_create_manager' (2a1e1c9b-6163-4c94-b873-a1e0c090309d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:11:44 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-5da3b61c-bcc9-44e4-9993-bfe95eeb71b2 tempest-VolumesGetTest-1922388409 None] Created volume successfully.
Jul 03 13:11:45 devstack sudo[99176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d
Jul 03 13:11:45 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-600ebe4e-688f-4b99-9874-a4f9cc9e7fe2 tempest-VolumesGetTest-1922388409 None] Acquiring lock "cinder-8a14eb3f-2f32-4183-bf9f-6b2f7bd6986a-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:11:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-600ebe4e-688f-4b99-9874-a4f9cc9e7fe2 tempest-VolumesGetTest-1922388409 None] Lock "cinder-8a14eb3f-2f32-4183-bf9f-6b2f7bd6986a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:11:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-600ebe4e-688f-4b99-9874-a4f9cc9e7fe2 tempest-VolumesGetTest-1922388409 None] Acquiring lock "cinder-quobyte-8a14eb3f-2f32-4183-bf9f-6b2f7bd6986a" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:11:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-600ebe4e-688f-4b99-9874-a4f9cc9e7fe2 tempest-VolumesGetTest-1922388409 None] Lock "cinder-quobyte-8a14eb3f-2f32-4183-bf9f-6b2f7bd6986a" acquired by "delete_volume" :: waited 0.014s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:11:45 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[4913c387-8cd7-429a-a84c-e3a6fc3cc297]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-600ebe4e-688f-4b99-9874-a4f9cc9e7fe2 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8a14eb3f-2f32-4183-bf9f-6b2f7bd6986a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:45 devstack sudo[99178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8a14eb3f-2f32-4183-bf9f-6b2f7bd6986a
Jul 03 13:11:45 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:45 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-643dd184-e934-46c3-b628-55fc16fd12f2 tempest-SnapshotDependencyTests-1051766090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d" returned: 0 in 0.934s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-643dd184-e934-46c3-b628-55fc16fd12f2 tempest-SnapshotDependencyTests-1051766090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.b1376335-1b3f-44e4-a498-eacedfae0d3f 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:45 devstack sudo[99183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.b1376335-1b3f-44e4-a498-eacedfae0d3f 1G
Jul 03 13:11:45 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:46 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-600ebe4e-688f-4b99-9874-a4f9cc9e7fe2 tempest-VolumesGetTest-1922388409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8a14eb3f-2f32-4183-bf9f-6b2f7bd6986a" returned: 0 in 0.827s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-600ebe4e-688f-4b99-9874-a4f9cc9e7fe2 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8a14eb3f-2f32-4183-bf9f-6b2f7bd6986a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:46 devstack sudo[99189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8a14eb3f-2f32-4183-bf9f-6b2f7bd6986a
Jul 03 13:11:46 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:46 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-643dd184-e934-46c3-b628-55fc16fd12f2 tempest-SnapshotDependencyTests-1051766090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.b1376335-1b3f-44e4-a498-eacedfae0d3f 1G" returned: 0 in 0.881s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-643dd184-e934-46c3-b628-55fc16fd12f2 tempest-SnapshotDependencyTests-1051766090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.b1376335-1b3f-44e4-a498-eacedfae0d3f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:46 devstack sudo[99194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.b1376335-1b3f-44e4-a498-eacedfae0d3f
Jul 03 13:11:46 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:46 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-600ebe4e-688f-4b99-9874-a4f9cc9e7fe2 tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8a14eb3f-2f32-4183-bf9f-6b2f7bd6986a" returned: 0 in 0.696s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:46 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-600ebe4e-688f-4b99-9874-a4f9cc9e7fe2 tempest-VolumesGetTest-1922388409 None] Lock "cinder-quobyte-8a14eb3f-2f32-4183-bf9f-6b2f7bd6986a" released by "delete_volume" :: held 1.576s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:11:47 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-600ebe4e-688f-4b99-9874-a4f9cc9e7fe2 tempest-VolumesGetTest-1922388409 None] Created reservations ['ee23f3dd-1687-4062-b30f-52b786fee032', '464c6efc-0936-4c4a-a78f-1d3d3e6e6653', '28d68596-f907-4cd2-bde7-ed64a3f97337', '44002c83-abc3-4f79-917d-9c1ae220256e'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:11:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-600ebe4e-688f-4b99-9874-a4f9cc9e7fe2 tempest-VolumesGetTest-1922388409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-600ebe4e-688f-4b99-9874-a4f9cc9e7fe2 tempest-VolumesGetTest-1922388409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:47 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-600ebe4e-688f-4b99-9874-a4f9cc9e7fe2 tempest-VolumesGetTest-1922388409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:11:47 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-600ebe4e-688f-4b99-9874-a4f9cc9e7fe2 tempest-VolumesGetTest-1922388409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:11:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-600ebe4e-688f-4b99-9874-a4f9cc9e7fe2 tempest-VolumesGetTest-1922388409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-600ebe4e-688f-4b99-9874-a4f9cc9e7fe2 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:47 devstack sudo[99197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:11:47 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:47 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-643dd184-e934-46c3-b628-55fc16fd12f2 tempest-SnapshotDependencyTests-1051766090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.b1376335-1b3f-44e4-a498-eacedfae0d3f" returned: 0 in 0.781s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:47 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-643dd184-e934-46c3-b628-55fc16fd12f2 tempest-SnapshotDependencyTests-1051766090 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.b1376335-1b3f-44e4-a498-eacedfae0d3f is being set with open permissions: ugo+rw
Jul 03 13:11:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-643dd184-e934-46c3-b628-55fc16fd12f2 tempest-SnapshotDependencyTests-1051766090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.b1376335-1b3f-44e4-a498-eacedfae0d3f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:47 devstack sudo[99202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.b1376335-1b3f-44e4-a498-eacedfae0d3f
Jul 03 13:11:47 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c0e8390b-1124-4406-bddb-de6097e59241 tempest-VolumesGetTest-1922388409 None] Acquiring lock "cinder-1e413be3-aa39-44d7-9733-1c4fe1ce5365-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:11:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c0e8390b-1124-4406-bddb-de6097e59241 tempest-VolumesGetTest-1922388409 None] Lock "cinder-1e413be3-aa39-44d7-9733-1c4fe1ce5365-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:11:47 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=67,cinder:INSERT=29,cinder:UPDATE=99,cinder:DELETE=5 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:11:47 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=87,cinder:INSERT=16,cinder:UPDATE=98,cinder:DELETE=7 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:11:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c0e8390b-1124-4406-bddb-de6097e59241 tempest-VolumesGetTest-1922388409 None] Acquiring lock "cinder-quobyte-1e413be3-aa39-44d7-9733-1c4fe1ce5365" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:11:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c0e8390b-1124-4406-bddb-de6097e59241 tempest-VolumesGetTest-1922388409 None] Lock "cinder-quobyte-1e413be3-aa39-44d7-9733-1c4fe1ce5365" acquired by "delete_volume" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:11:47 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0b35ed-6317-45b8-8569-2b054d7020b3]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c0e8390b-1124-4406-bddb-de6097e59241 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1e413be3-aa39-44d7-9733-1c4fe1ce5365 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:47 devstack sudo[99204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1e413be3-aa39-44d7-9733-1c4fe1ce5365
Jul 03 13:11:47 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:47 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-600ebe4e-688f-4b99-9874-a4f9cc9e7fe2 tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.804s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:47 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-600ebe4e-688f-4b99-9874-a4f9cc9e7fe2 tempest-VolumesGetTest-1922388409 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:11:47 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-600ebe4e-688f-4b99-9874-a4f9cc9e7fe2 tempest-VolumesGetTest-1922388409 None] Deleted volume successfully.
Jul 03 13:11:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-600ebe4e-688f-4b99-9874-a4f9cc9e7fe2 tempest-VolumesGetTest-1922388409 None] Lock "cinder-8a14eb3f-2f32-4183-bf9f-6b2f7bd6986a-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:11:48 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-643dd184-e934-46c3-b628-55fc16fd12f2 tempest-SnapshotDependencyTests-1051766090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.b1376335-1b3f-44e4-a498-eacedfae0d3f" returned: 0 in 0.700s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-643dd184-e934-46c3-b628-55fc16fd12f2 tempest-SnapshotDependencyTests-1051766090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:48 devstack sudo[99208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.info
Jul 03 13:11:48 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:48 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c0e8390b-1124-4406-bddb-de6097e59241 tempest-VolumesGetTest-1922388409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1e413be3-aa39-44d7-9733-1c4fe1ce5365" returned: 0 in 0.803s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c0e8390b-1124-4406-bddb-de6097e59241 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1e413be3-aa39-44d7-9733-1c4fe1ce5365 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:48 devstack sudo[99213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1e413be3-aa39-44d7-9733-1c4fe1ce5365
Jul 03 13:11:48 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:49 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-643dd184-e934-46c3-b628-55fc16fd12f2 tempest-SnapshotDependencyTests-1051766090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.info" returned: 0 in 0.793s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:49 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-643dd184-e934-46c3-b628-55fc16fd12f2 tempest-SnapshotDependencyTests-1051766090 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.info is being set with open permissions: ugo+rw
Jul 03 13:11:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-643dd184-e934-46c3-b628-55fc16fd12f2 tempest-SnapshotDependencyTests-1051766090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:49 devstack sudo[99216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.info
Jul 03 13:11:49 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:49 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c0e8390b-1124-4406-bddb-de6097e59241 tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1e413be3-aa39-44d7-9733-1c4fe1ce5365" returned: 0 in 0.636s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c0e8390b-1124-4406-bddb-de6097e59241 tempest-VolumesGetTest-1922388409 None] Lock "cinder-quobyte-1e413be3-aa39-44d7-9733-1c4fe1ce5365" released by "delete_volume" :: held 1.501s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:11:49 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-c0e8390b-1124-4406-bddb-de6097e59241 tempest-VolumesGetTest-1922388409 None] Created reservations ['12e49b34-e76a-44b6-9d40-bd54a2491972', 'c973ce7f-13ee-401e-bcf3-663a738cdf88', 'b4721bb2-dc5b-48c8-84ea-e7ca6b990243', 'a8e74958-1916-441a-adbb-419e8b01cc2e'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:11:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c0e8390b-1124-4406-bddb-de6097e59241 tempest-VolumesGetTest-1922388409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c0e8390b-1124-4406-bddb-de6097e59241 tempest-VolumesGetTest-1922388409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c0e8390b-1124-4406-bddb-de6097e59241 tempest-VolumesGetTest-1922388409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:11:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c0e8390b-1124-4406-bddb-de6097e59241 tempest-VolumesGetTest-1922388409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:11:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c0e8390b-1124-4406-bddb-de6097e59241 tempest-VolumesGetTest-1922388409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c0e8390b-1124-4406-bddb-de6097e59241 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:49 devstack sudo[99219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:11:49 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:49 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-643dd184-e934-46c3-b628-55fc16fd12f2 tempest-SnapshotDependencyTests-1051766090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.info" returned: 0 in 0.662s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-643dd184-e934-46c3-b628-55fc16fd12f2 tempest-SnapshotDependencyTests-1051766090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.866s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.518s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-534156760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d42f25d-9396-447d-96f4-75c624e8c2b5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9c121f868e3e4633870db4ddf8db6dc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:11:43Z,use_quota=True,user_id='f233101b17ad4133b570dae808044486',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:11:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Creating volume 7d42f25d-9396-447d-96f4-75c624e8c2b5 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:11:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:11:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:11:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:11:49 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:11:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d42f25d-9396-447d-96f4-75c624e8c2b5 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:49 devstack sudo[99222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d42f25d-9396-447d-96f4-75c624e8c2b5 1073741824
Jul 03 13:11:49 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:49 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-643dd184-e934-46c3-b628-55fc16fd12f2 tempest-SnapshotDependencyTests-1051766090 None] Create snapshot completed successfully
Jul 03 13:11:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d0bcbbb5-9067-4ad0-a9b5-9614cfb5cdf5 tempest-VolumesGetTest-1922388409 None] Acquiring lock "cinder-693ab3f0-09a1-46de-82aa-981b36fc6de5-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:11:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d0bcbbb5-9067-4ad0-a9b5-9614cfb5cdf5 tempest-VolumesGetTest-1922388409 None] Lock "cinder-693ab3f0-09a1-46de-82aa-981b36fc6de5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:11:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d0bcbbb5-9067-4ad0-a9b5-9614cfb5cdf5 tempest-VolumesGetTest-1922388409 None] Acquiring lock "cinder-quobyte-693ab3f0-09a1-46de-82aa-981b36fc6de5" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:11:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d0bcbbb5-9067-4ad0-a9b5-9614cfb5cdf5 tempest-VolumesGetTest-1922388409 None] Lock "cinder-quobyte-693ab3f0-09a1-46de-82aa-981b36fc6de5" acquired by "delete_volume" :: waited 0.022s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:11:50 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a044401e-8da0-45c7-a40e-cb1357fa91a5]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d0bcbbb5-9067-4ad0-a9b5-9614cfb5cdf5 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:50 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c0e8390b-1124-4406-bddb-de6097e59241 tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.766s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:50 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-c0e8390b-1124-4406-bddb-de6097e59241 tempest-VolumesGetTest-1922388409 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:11:50 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-c0e8390b-1124-4406-bddb-de6097e59241 tempest-VolumesGetTest-1922388409 None] Deleted volume successfully.
Jul 03 13:11:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c0e8390b-1124-4406-bddb-de6097e59241 tempest-VolumesGetTest-1922388409 None] Lock "cinder-1e413be3-aa39-44d7-9733-1c4fe1ce5365-delete_volume" released by "delete_volume" :: held 2.575s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:11:50 devstack sudo[99225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5
Jul 03 13:11:50 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:50 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d42f25d-9396-447d-96f4-75c624e8c2b5 1073741824" returned: 0 in 0.966s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d42f25d-9396-447d-96f4-75c624e8c2b5 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:50 devstack sudo[99231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d42f25d-9396-447d-96f4-75c624e8c2b5
Jul 03 13:11:50 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:51 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d0bcbbb5-9067-4ad0-a9b5-9614cfb5cdf5 tempest-VolumesGetTest-1922388409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5" returned: 0 in 0.903s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d0bcbbb5-9067-4ad0-a9b5-9614cfb5cdf5 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:51 devstack sudo[99236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5
Jul 03 13:11:51 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Flow 'volume_create_manager' (9f0b587d-3ba1-4be6-a525-8e1753dd1a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e376da-5a65-4749-b7af-6f12da1f31f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e376da-5a65-4749-b7af-6f12da1f31f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b856adaa-eb03-4213-9a7b-42d1f6969e45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b79a258a0a40a5a43edf42dd14cc4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b1376335-1b3f-44e4-a498-eacedfae0d3f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:11:51Z,use_quota=True,user_id='b7198d7fc5ca4efb8e06fb44d1a46165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1464a17-e747-4fbf-9848-71490cb4ad94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1464a17-e747-4fbf-9848-71490cb4ad94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70a278f-b5b6-44cc-b5ce-fd670bcafd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70a278f-b5b6-44cc-b5ce-fd670bcafd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b856adaa-eb03-4213-9a7b-42d1f6969e45', 'volume_name': 'volume-b856adaa-eb03-4213-9a7b-42d1f6969e45', 'volume_size': 1, 'snapshot_id': 'b1376335-1b3f-44e4-a498-eacedfae0d3f'}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a88e8e5-a1a7-428e-b758-bf064c3841a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a88e8e5-a1a7-428e-b758-bf064c3841a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc093d22-b4f8-4c47-9a92-1e8517223f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:51 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Volume b856adaa-eb03-4213-9a7b-42d1f6969e45: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b856adaa-eb03-4213-9a7b-42d1f6969e45', 'volume_size': 1, 'snapshot_id': 'b1376335-1b3f-44e4-a498-eacedfae0d3f'}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:51 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d42f25d-9396-447d-96f4-75c624e8c2b5" returned: 0 in 0.812s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0f183b99-3217-487e-9a16-2fa8113657ef tempest-SnapshotsActionsTest-414207452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.880s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-0f183b99-3217-487e-9a16-2fa8113657ef tempest-SnapshotsActionsTest-414207452 None] Creating offline snapshot 7cc6e7d1-2683-4f95-950a-06eea69bd936 of volume e7184d0a-0b90-4316-880f-f2c5125f768d {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153c175b-72e5-40af-9f3c-182d9a4ee2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d42f25d-9396-447d-96f4-75c624e8c2b5', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (627686d1-f86c-4d5f-99ac-593e25bae187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[1759110f-b51b-48ff-ad25-6d4b91aa1e5a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0f183b99-3217-487e-9a16-2fa8113657ef tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:51 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Volume volume-7d42f25d-9396-447d-96f4-75c624e8c2b5 (7d42f25d-9396-447d-96f4-75c624e8c2b5): created successfully
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (627686d1-f86c-4d5f-99ac-593e25bae187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Flow 'volume_create_manager' (f9b11c5e-44a4-4715-8908-08d3047b14dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:11:51 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-84e328a2-ca26-42ae-b945-5c7f18fbb758 tempest-VolumesTestJSON-326027331 None] Created volume successfully.
Jul 03 13:11:51 devstack sudo[99239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d
Jul 03 13:11:51 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:51 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d0bcbbb5-9067-4ad0-a9b5-9614cfb5cdf5 tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-693ab3f0-09a1-46de-82aa-981b36fc6de5" returned: 0 in 0.727s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d0bcbbb5-9067-4ad0-a9b5-9614cfb5cdf5 tempest-VolumesGetTest-1922388409 None] Lock "cinder-quobyte-693ab3f0-09a1-46de-82aa-981b36fc6de5" released by "delete_volume" :: held 1.711s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-d0bcbbb5-9067-4ad0-a9b5-9614cfb5cdf5 tempest-VolumesGetTest-1922388409 None] Created reservations ['f51d1e43-f36f-4835-abc7-83c112080e63', '3c26da96-5ac8-483b-bc4f-7e64f6fd1f8d', '425a7b26-d918-4287-9845-dd944a8cef66', '7ef580c3-2f8a-4e08-854f-536ea6adf956'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d0bcbbb5-9067-4ad0-a9b5-9614cfb5cdf5 tempest-VolumesGetTest-1922388409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d0bcbbb5-9067-4ad0-a9b5-9614cfb5cdf5 tempest-VolumesGetTest-1922388409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d0bcbbb5-9067-4ad0-a9b5-9614cfb5cdf5 tempest-VolumesGetTest-1922388409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d0bcbbb5-9067-4ad0-a9b5-9614cfb5cdf5 tempest-VolumesGetTest-1922388409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d0bcbbb5-9067-4ad0-a9b5-9614cfb5cdf5 tempest-VolumesGetTest-1922388409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d0bcbbb5-9067-4ad0-a9b5-9614cfb5cdf5 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:51 devstack sudo[99242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:11:51 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:52 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0f183b99-3217-487e-9a16-2fa8113657ef tempest-SnapshotsActionsTest-414207452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d" returned: 0 in 0.888s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0f183b99-3217-487e-9a16-2fa8113657ef tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:52 devstack sudo[99247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 1G
Jul 03 13:11:52 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:52 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d0bcbbb5-9067-4ad0-a9b5-9614cfb5cdf5 tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.799s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:52 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-d0bcbbb5-9067-4ad0-a9b5-9614cfb5cdf5 tempest-VolumesGetTest-1922388409 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:11:52 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-d0bcbbb5-9067-4ad0-a9b5-9614cfb5cdf5 tempest-VolumesGetTest-1922388409 None] Deleted volume successfully.
Jul 03 13:11:52 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d0bcbbb5-9067-4ad0-a9b5-9614cfb5cdf5 tempest-VolumesGetTest-1922388409 None] Lock "cinder-693ab3f0-09a1-46de-82aa-981b36fc6de5-delete_volume" released by "delete_volume" :: held 2.755s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:11:53 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:11:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Flow 'volume_create_manager' (fdd25716-6e71-4a39-acb0-c858da869062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:11:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8619a8-fa7b-42c3-bcee-7fb1f5e7ba91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:53 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:11:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Flow 'volume_create_manager' (18642257-addb-4184-917c-3af634b637a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:11:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e746390-3302-46fb-86d7-4a99015eff37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8619a8-fa7b-42c3-bcee-7fb1f5e7ba91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1746592637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3d355ad-c940-4b17-ab80-843d3c522d11,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='41f3d519e48d44dfa81cc5bd48f8acee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:11:53Z,use_quota=True,user_id='97064b55755d41f1849fde163b43474a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a2030b6-83bd-4840-886d-55757e9a4a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a2030b6-83bd-4840-886d-55757e9a4a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (324d9fb1-0925-4835-9ab8-8b4dbe6d608c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:53 devstack cinder-volume[86837]: DEBUG cinder.image.glance [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Creating Keystone auth plugin from conf {{(pid=86837) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 13:11:53 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0f183b99-3217-487e-9a16-2fa8113657ef tempest-SnapshotsActionsTest-414207452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 1G" returned: 0 in 1.096s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0f183b99-3217-487e-9a16-2fa8113657ef tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7184d0a-0b90-4316-880f-f2c5125f768d -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e746390-3302-46fb-86d7-4a99015eff37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1455837639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b51349b0-cab8-43a9-be02-8692abb9dd62,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9c121f868e3e4633870db4ddf8db6dc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:11:53Z,use_quota=True,user_id='f233101b17ad4133b570dae808044486',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b8d369-2a7e-4080-8f5f-11f0b33a777b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b8d369-2a7e-4080-8f5f-11f0b33a777b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:53 devstack sudo[99257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7184d0a-0b90-4316-880f-f2c5125f768d -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936
Jul 03 13:11:53 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3505bb56-4752-4300-95d3-db0096428984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3505bb56-4752-4300-95d3-db0096428984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b51349b0-cab8-43a9-be02-8692abb9dd62', 'volume_name': 'volume-b51349b0-cab8-43a9-be02-8692abb9dd62', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (021f3033-d9cf-455d-9b7b-9be746df508b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (021f3033-d9cf-455d-9b7b-9be746df508b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc1a74b-7673-40f4-9a74-d67cc5f20c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:53 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Volume b51349b0-cab8-43a9-be02-8692abb9dd62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b51349b0-cab8-43a9-be02-8692abb9dd62', 'volume_size': 1}
Jul 03 13:11:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (324d9fb1-0925-4835-9ab8-8b4dbe6d608c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b3d355ad-c940-4b17-ab80-843d3c522d11', 'volume_name': 'volume-b3d355ad-c940-4b17-ab80-843d3c522d11', 'volume_size': 1, 'image_id': '6205b5bb-0e52-4074-98de-35ab3e76638b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6205b5bb-0e52-4074-98de-35ab3e76638b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c125c5701081483fb4d62cc48d112711', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6205b5bb-0e52-4074-98de-35ab3e76638b', 'created_at': datetime.datetime(2026, 7, 3, 10, 50, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 50, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6205b5bb-0e52-4074-98de-35ab3e76638b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7aa53be32d50>}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f84764-e3de-4d13-bfdb-62d65e6495a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f84764-e3de-4d13-bfdb-62d65e6495a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:11:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00c74880-8fcd-42e6-895d-4f192e3c3ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:11:53 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Volume b3d355ad-c940-4b17-ab80-843d3c522d11: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b3d355ad-c940-4b17-ab80-843d3c522d11', 'volume_size': 1, 'image_id': '6205b5bb-0e52-4074-98de-35ab3e76638b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6205b5bb-0e52-4074-98de-35ab3e76638b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c125c5701081483fb4d62cc48d112711', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6205b5bb-0e52-4074-98de-35ab3e76638b', 'created_at': datetime.datetime(2026, 7, 3, 10, 50, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 50, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6205b5bb-0e52-4074-98de-35ab3e76638b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7aa53be32d50>}
Jul 03 13:11:53 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Trying to clone b3d355ad-c940-4b17-ab80-843d3c522d11 from image 6205b5bb-0e52-4074-98de-35ab3e76638b at location (None, [{'url': 'file:///opt/stack/data/glance/images/6205b5bb-0e52-4074-98de-35ab3e76638b', 'metadata': {}}]). {{(pid=86837) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 03 13:11:54 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_4hd64tjldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86837) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 03 13:11:54 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Image download 20.69 MB at 20.69 MB/s
Jul 03 13:11:54 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c96c287-e67b-4df1-befc-93d3d1806759]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_4hd64tjldevstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:54 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0f183b99-3217-487e-9a16-2fa8113657ef tempest-SnapshotsActionsTest-414207452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7184d0a-0b90-4316-880f-f2c5125f768d -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936" returned: 0 in 0.914s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:54 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-0f183b99-3217-487e-9a16-2fa8113657ef tempest-SnapshotsActionsTest-414207452 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 is being set with open permissions: ugo+rw
Jul 03 13:11:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0f183b99-3217-487e-9a16-2fa8113657ef tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:54 devstack sudo[99265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936
Jul 03 13:11:54 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:54 devstack sudo[99264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_4hd64tjldevstack@QuobyteHD
Jul 03 13:11:54 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:55 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0f183b99-3217-487e-9a16-2fa8113657ef tempest-SnapshotsActionsTest-414207452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936" returned: 0 in 0.739s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0f183b99-3217-487e-9a16-2fa8113657ef tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:55 devstack sudo[99274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.info
Jul 03 13:11:55 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:55 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_4hd64tjldevstack@QuobyteHD" returned: 0 in 0.880s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:55 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Temporary image 6205b5bb-0e52-4074-98de-35ab3e76638b is fetched for user 97064b55755d41f1849fde163b43474a. {{(pid=86837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 03 13:11:55 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf72b8d-204c-4689-9c30-2164a0dce149]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_4hd64tjldevstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:55 devstack sudo[99276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_4hd64tjldevstack@QuobyteHD
Jul 03 13:11:55 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:55 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0f183b99-3217-487e-9a16-2fa8113657ef tempest-SnapshotsActionsTest-414207452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.info" returned: 0 in 0.712s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:55 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-0f183b99-3217-487e-9a16-2fa8113657ef tempest-SnapshotsActionsTest-414207452 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.info is being set with open permissions: ugo+rw
Jul 03 13:11:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0f183b99-3217-487e-9a16-2fa8113657ef tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:56 devstack sudo[99279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.info
Jul 03 13:11:56 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:56 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_4hd64tjldevstack@QuobyteHD" returned: 0 in 0.786s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:56 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0f183b99-3217-487e-9a16-2fa8113657ef tempest-SnapshotsActionsTest-414207452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.info" returned: 0 in 0.693s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0f183b99-3217-487e-9a16-2fa8113657ef tempest-SnapshotsActionsTest-414207452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.144s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.317s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:56 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Acquiring lock "cinder-quobyte-b1376335-1b3f-44e4-a498-eacedfae0d3f-b856adaa-eb03-4213-9a7b-42d1f6969e45" by "_create_volume_from_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:11:56 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Lock "cinder-quobyte-b1376335-1b3f-44e4-a498-eacedfae0d3f-b856adaa-eb03-4213-9a7b-42d1f6969e45" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:11:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Creating volume b856adaa-eb03-4213-9a7b-42d1f6969e45 from snapshot b1376335-1b3f-44e4-a498-eacedfae0d3f {{(pid=86837) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 13:11:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:11:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:11:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:11:56 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Acquiring lock "cinder-quobyte-b856adaa-eb03-4213-9a7b-42d1f6969e45" by "_copy_volume_from_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:11:56 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-0f183b99-3217-487e-9a16-2fa8113657ef tempest-SnapshotsActionsTest-414207452 None] Create snapshot completed successfully
Jul 03 13:11:56 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Lock "cinder-quobyte-b856adaa-eb03-4213-9a7b-42d1f6969e45" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:11:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] snapshot: b1376335-1b3f-44e4-a498-eacedfae0d3f, volume: b856adaa-eb03-4213-9a7b-42d1f6969e45,  {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 13:11:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:11:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:11:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:11:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:11:56 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[171fd0ae-1fcb-404e-811d-6a209c077c01]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.b1376335-1b3f-44e4-a498-eacedfae0d3f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:56 devstack sudo[99285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.b1376335-1b3f-44e4-a498-eacedfae0d3f
Jul 03 13:11:56 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:57 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.b1376335-1b3f-44e4-a498-eacedfae0d3f" returned: 0 in 0.850s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:11:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 13:11:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Creating direct copy from snapshot {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 13:11:57 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[50009a69-aa95-4712-b400-0057d44ac522]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:11:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:57 devstack sudo[99290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d
Jul 03 13:11:57 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:11:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a5710339-e88d-4722-9eca-09ee69150fae tempest-SnapshotsActionsTest-414207452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:11:58 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root
Jul 03 13:11:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d" returned: 0 in 0.878s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:11:58 devstack cinder-volume[86837]: DEBUG cinder.utils [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Path /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b856adaa-eb03-4213-9a7b-42d1f6969e45 not found in is_blk_device check {{(pid=86837) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 13:11:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b856adaa-eb03-4213-9a7b-42d1f6969e45 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:11:58 devstack sudo[99296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b856adaa-eb03-4213-9a7b-42d1f6969e45
Jul 03 13:11:58 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:03 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b856adaa-eb03-4213-9a7b-42d1f6969e45" returned: 0 in 4.591s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:03 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa94689-d0c2-4b68-9606-94adb677b459]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:03 devstack sudo[99312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d
Jul 03 13:12:03 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:04 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d" returned: 0 in 0.901s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:04 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d, size 1024.00 MB, duration 4.59 sec, destination /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b856adaa-eb03-4213-9a7b-42d1f6969e45 {{(pid=86837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 13:12:04 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Converted 1024.00 MB image at 222.99 MB/s
Jul 03 13:12:04 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b856adaa-eb03-4213-9a7b-42d1f6969e45 is being set with open permissions: ugo+rw
Jul 03 13:12:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b856adaa-eb03-4213-9a7b-42d1f6969e45 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:04 devstack sudo[99317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b856adaa-eb03-4213-9a7b-42d1f6969e45
Jul 03 13:12:04 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:04 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b856adaa-eb03-4213-9a7b-42d1f6969e45" returned: 0 in 0.607s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Lock "cinder-quobyte-b856adaa-eb03-4213-9a7b-42d1f6969e45" released by "_copy_volume_from_snapshot" :: held 7.931s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Lock "cinder-quobyte-b1376335-1b3f-44e4-a498-eacedfae0d3f-b856adaa-eb03-4213-9a7b-42d1f6969e45" released by "_create_volume_from_snapshot" :: held 7.969s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.994s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:12:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.050s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:12:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1455837639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b51349b0-cab8-43a9-be02-8692abb9dd62,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9c121f868e3e4633870db4ddf8db6dc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:11:53Z,use_quota=True,user_id='f233101b17ad4133b570dae808044486',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:12:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Creating volume b51349b0-cab8-43a9-be02-8692abb9dd62 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:12:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:12:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:12:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:12:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:12:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:12:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:12:04 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:12:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b51349b0-cab8-43a9-be02-8692abb9dd62 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:04 devstack sudo[99320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b51349b0-cab8-43a9-be02-8692abb9dd62 1073741824
Jul 03 13:12:04 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc093d22-b4f8-4c47-9a92-1e8517223f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b856adaa-eb03-4213-9a7b-42d1f6969e45', 'volume_size': 1, 'snapshot_id': 'b1376335-1b3f-44e4-a498-eacedfae0d3f'}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:12:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e454f4-ece2-4b00-b611-bcfbdbdecbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:12:04 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Volume volume-b856adaa-eb03-4213-9a7b-42d1f6969e45 (b856adaa-eb03-4213-9a7b-42d1f6969e45): created successfully
Jul 03 13:12:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e454f4-ece2-4b00-b611-bcfbdbdecbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:12:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Flow 'volume_create_manager' (9f0b587d-3ba1-4be6-a525-8e1753dd1a40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:12:04 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-3501face-d85c-4961-976d-9153f70a8794 tempest-SnapshotDependencyTests-1051766090 None] Created volume successfully.
Jul 03 13:12:05 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-95d72c76-892c-4fb3-b6f5-8455545bde60 tempest-SnapshotDependencyTests-1051766090 None] Acquiring lock "cinder-b1376335-1b3f-44e4-a498-eacedfae0d3f-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:05 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-95d72c76-892c-4fb3-b6f5-8455545bde60 tempest-SnapshotDependencyTests-1051766090 None] Lock "cinder-b1376335-1b3f-44e4-a498-eacedfae0d3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:05 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-95d72c76-892c-4fb3-b6f5-8455545bde60 tempest-SnapshotDependencyTests-1051766090 None] Acquiring lock "cinder-quobyte-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:05 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-95d72c76-892c-4fb3-b6f5-8455545bde60 tempest-SnapshotDependencyTests-1051766090 None] Lock "cinder-quobyte-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:05 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-95d72c76-892c-4fb3-b6f5-8455545bde60 tempest-SnapshotDependencyTests-1051766090 None] Acquiring lock "cinder-quobyte-b1376335-1b3f-44e4-a498-eacedfae0d3f" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:05 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-95d72c76-892c-4fb3-b6f5-8455545bde60 tempest-SnapshotDependencyTests-1051766090 None] Lock "cinder-quobyte-b1376335-1b3f-44e4-a498-eacedfae0d3f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:05 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-95d72c76-892c-4fb3-b6f5-8455545bde60 tempest-SnapshotDependencyTests-1051766090 None] Deleting offline snapshot b1376335-1b3f-44e4-a498-eacedfae0d3f of volume 6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:12:05 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-95d72c76-892c-4fb3-b6f5-8455545bde60 tempest-SnapshotDependencyTests-1051766090 None] snapshot_file for this snap is: volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.b1376335-1b3f-44e4-a498-eacedfae0d3f {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:12:05 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80a4bc3-273c-43c6-9a0a-38d3a6908ebd]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-95d72c76-892c-4fb3-b6f5-8455545bde60 tempest-SnapshotDependencyTests-1051766090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.b1376335-1b3f-44e4-a498-eacedfae0d3f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:05 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b51349b0-cab8-43a9-be02-8692abb9dd62 1073741824" returned: 0 in 0.858s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b51349b0-cab8-43a9-be02-8692abb9dd62 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:05 devstack sudo[99326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.b1376335-1b3f-44e4-a498-eacedfae0d3f
Jul 03 13:12:05 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:05 devstack sudo[99327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b51349b0-cab8-43a9-be02-8692abb9dd62
Jul 03 13:12:05 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:06 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b51349b0-cab8-43a9-be02-8692abb9dd62" returned: 0 in 0.650s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:12:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:12:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.068s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:12:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1746592637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3d355ad-c940-4b17-ab80-843d3c522d11,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='41f3d519e48d44dfa81cc5bd48f8acee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:11:53Z,use_quota=True,user_id='97064b55755d41f1849fde163b43474a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:12:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Creating volume b3d355ad-c940-4b17-ab80-843d3c522d11 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:12:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:12:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:12:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:12:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:12:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:12:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:12:06 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:12:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:06 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-95d72c76-892c-4fb3-b6f5-8455545bde60 tempest-SnapshotDependencyTests-1051766090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.b1376335-1b3f-44e4-a498-eacedfae0d3f" returned: 0 in 0.796s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-95d72c76-892c-4fb3-b6f5-8455545bde60 tempest-SnapshotDependencyTests-1051766090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:12:06 devstack sudo[99334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11 1073741824
Jul 03 13:12:06 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc1a74b-7673-40f4-9a74-d67cc5f20c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b51349b0-cab8-43a9-be02-8692abb9dd62', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:12:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77719e63-5f54-4137-a5fe-31d9f3ebec55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:12:06 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f817c30a-c131-4eff-a239-a8e0e0ce2108]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-95d72c76-892c-4fb3-b6f5-8455545bde60 tempest-SnapshotDependencyTests-1051766090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:06 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Volume volume-b51349b0-cab8-43a9-be02-8692abb9dd62 (b51349b0-cab8-43a9-be02-8692abb9dd62): created successfully
Jul 03 13:12:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77719e63-5f54-4137-a5fe-31d9f3ebec55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:12:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Flow 'volume_create_manager' (18642257-addb-4184-917c-3af634b637a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:12:06 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-db5eab75-4f53-4c9e-a748-e850663e695d tempest-VolumesTestJSON-326027331 None] Created volume successfully.
Jul 03 13:12:06 devstack sudo[99336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d
Jul 03 13:12:06 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:07 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-95d72c76-892c-4fb3-b6f5-8455545bde60 tempest-SnapshotDependencyTests-1051766090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d" returned: 0 in 0.838s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-95d72c76-892c-4fb3-b6f5-8455545bde60 tempest-SnapshotDependencyTests-1051766090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.b1376335-1b3f-44e4-a498-eacedfae0d3f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:07 devstack sudo[99345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.b1376335-1b3f-44e4-a498-eacedfae0d3f
Jul 03 13:12:07 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:07 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11 1073741824" returned: 0 in 0.982s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:07 devstack sudo[99347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11
Jul 03 13:12:07 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-38752b8d-6c33-4c70-9c27-1e20053a6beb tempest-VolumesTestJSON-326027331 None] Acquiring lock "cinder-b51349b0-cab8-43a9-be02-8692abb9dd62-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-38752b8d-6c33-4c70-9c27-1e20053a6beb tempest-VolumesTestJSON-326027331 None] Lock "cinder-b51349b0-cab8-43a9-be02-8692abb9dd62-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-38752b8d-6c33-4c70-9c27-1e20053a6beb tempest-VolumesTestJSON-326027331 None] Acquiring lock "cinder-quobyte-b51349b0-cab8-43a9-be02-8692abb9dd62" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-38752b8d-6c33-4c70-9c27-1e20053a6beb tempest-VolumesTestJSON-326027331 None] Lock "cinder-quobyte-b51349b0-cab8-43a9-be02-8692abb9dd62" acquired by "delete_volume" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:07 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c30afd-f683-4f61-b375-20ff1dba4bc9]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-38752b8d-6c33-4c70-9c27-1e20053a6beb tempest-VolumesTestJSON-326027331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b51349b0-cab8-43a9-be02-8692abb9dd62 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:07 devstack sudo[99351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b51349b0-cab8-43a9-be02-8692abb9dd62
Jul 03 13:12:07 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:08 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-95d72c76-892c-4fb3-b6f5-8455545bde60 tempest-SnapshotDependencyTests-1051766090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.b1376335-1b3f-44e4-a498-eacedfae0d3f" returned: 0 in 0.845s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-95d72c76-892c-4fb3-b6f5-8455545bde60 tempest-SnapshotDependencyTests-1051766090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.b1376335-1b3f-44e4-a498-eacedfae0d3f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:08 devstack sudo[99355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.b1376335-1b3f-44e4-a498-eacedfae0d3f
Jul 03 13:12:08 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:08 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11" returned: 0 in 0.761s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:12:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:12:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a5710339-e88d-4722-9eca-09ee69150fae tempest-SnapshotsActionsTest-414207452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.148s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:12:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-a5710339-e88d-4722-9eca-09ee69150fae tempest-SnapshotsActionsTest-414207452 None] Creating offline snapshot 1560c67a-47e8-4828-9e84-15a96c348ccf of volume e7184d0a-0b90-4316-880f-f2c5125f768d {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:12:08 devstack cinder-volume[86837]: DEBUG cinder.volume.volume_utils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Attempting download of 6205b5bb-0e52-4074-98de-35ab3e76638b ((None, [{'url': 'file:///opt/stack/data/glance/images/6205b5bb-0e52-4074-98de-35ab3e76638b', 'metadata': {}}])) to volume b3d355ad-c940-4b17-ab80-843d3c522d11. {{(pid=86837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 03 13:12:08 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[523b6a8b-5bbf-43a6-903c-a2e54c333f37]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a5710339-e88d-4722-9eca-09ee69150fae tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:08 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de4a930-977a-4fd3-84fc-4e71af8625fe]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6205b5bb-0e52-4074-98de-35ab3e76638b_4j8vz0o6 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:08 devstack sudo[99357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936
Jul 03 13:12:08 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:08 devstack sudo[99358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6205b5bb-0e52-4074-98de-35ab3e76638b_4j8vz0o6
Jul 03 13:12:08 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:08 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-38752b8d-6c33-4c70-9c27-1e20053a6beb tempest-VolumesTestJSON-326027331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b51349b0-cab8-43a9-be02-8692abb9dd62" returned: 0 in 0.892s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-38752b8d-6c33-4c70-9c27-1e20053a6beb tempest-VolumesTestJSON-326027331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b51349b0-cab8-43a9-be02-8692abb9dd62 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:08 devstack sudo[99365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b51349b0-cab8-43a9-be02-8692abb9dd62
Jul 03 13:12:08 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:08 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-95d72c76-892c-4fb3-b6f5-8455545bde60 tempest-SnapshotDependencyTests-1051766090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d.b1376335-1b3f-44e4-a498-eacedfae0d3f" returned: 0 in 0.736s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-95d72c76-892c-4fb3-b6f5-8455545bde60 tempest-SnapshotDependencyTests-1051766090 None] Lock "cinder-quobyte-b1376335-1b3f-44e4-a498-eacedfae0d3f" released by "_delete_snapshot" :: held 3.348s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-95d72c76-892c-4fb3-b6f5-8455545bde60 tempest-SnapshotDependencyTests-1051766090 None] Lock "cinder-quobyte-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d" released by "delete_snapshot" :: held 3.384s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:08 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-95d72c76-892c-4fb3-b6f5-8455545bde60 tempest-SnapshotDependencyTests-1051766090 None] Created reservations ['1abe80a9-f7df-45ba-b0de-9af2930b916b', 'fb4f84fc-2727-4079-880b-1b5ce5d51124', '284e3450-bdee-4489-a4bd-a9a9c5ea7b16', '82627236-bc09-40b1-8609-4be6fefae2ef'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:12:09 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-95d72c76-892c-4fb3-b6f5-8455545bde60 tempest-SnapshotDependencyTests-1051766090 None] Delete snapshot completed successfully.
Jul 03 13:12:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-95d72c76-892c-4fb3-b6f5-8455545bde60 tempest-SnapshotDependencyTests-1051766090 None] Lock "cinder-b1376335-1b3f-44e4-a498-eacedfae0d3f-delete_snapshot" released by "delete_snapshot" :: held 3.653s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:09 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6205b5bb-0e52-4074-98de-35ab3e76638b_4j8vz0o6" returned: 0 in 0.972s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6205b5bb-0e52-4074-98de-35ab3e76638b_4j8vz0o6 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:09 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a5710339-e88d-4722-9eca-09ee69150fae tempest-SnapshotsActionsTest-414207452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936" returned: 0 in 1.043s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-a5710339-e88d-4722-9eca-09ee69150fae tempest-SnapshotsActionsTest-414207452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7184d0a-0b90-4316-880f-f2c5125f768d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:12:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a5710339-e88d-4722-9eca-09ee69150fae tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.1560c67a-47e8-4828-9e84-15a96c348ccf 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:09 devstack sudo[99373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.1560c67a-47e8-4828-9e84-15a96c348ccf 1G
Jul 03 13:12:09 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:09 devstack sudo[99372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6205b5bb-0e52-4074-98de-35ab3e76638b_4j8vz0o6
Jul 03 13:12:09 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:09 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-38752b8d-6c33-4c70-9c27-1e20053a6beb tempest-VolumesTestJSON-326027331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b51349b0-cab8-43a9-be02-8692abb9dd62" returned: 0 in 0.870s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-38752b8d-6c33-4c70-9c27-1e20053a6beb tempest-VolumesTestJSON-326027331 None] Lock "cinder-quobyte-b51349b0-cab8-43a9-be02-8692abb9dd62" released by "delete_volume" :: held 1.818s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:09 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-38752b8d-6c33-4c70-9c27-1e20053a6beb tempest-VolumesTestJSON-326027331 None] Created reservations ['d43ec9c0-6413-43f9-9ec2-292e91ddc797', 'c68eb69b-96ed-44f8-a9dc-13e44647edd9', '29ff4dde-c962-4ade-bbda-faf672949dc2', '5c286952-14fb-47f4-95cf-5a986878bbd9'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:12:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e42fe682-accb-415a-8013-c852d51f7f68 tempest-SnapshotDependencyTests-1051766090 None] Acquiring lock "cinder-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e42fe682-accb-415a-8013-c852d51f7f68 tempest-SnapshotDependencyTests-1051766090 None] Lock "cinder-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-38752b8d-6c33-4c70-9c27-1e20053a6beb tempest-VolumesTestJSON-326027331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:12:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-38752b8d-6c33-4c70-9c27-1e20053a6beb tempest-VolumesTestJSON-326027331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:12:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-38752b8d-6c33-4c70-9c27-1e20053a6beb tempest-VolumesTestJSON-326027331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:12:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-38752b8d-6c33-4c70-9c27-1e20053a6beb tempest-VolumesTestJSON-326027331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:12:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-38752b8d-6c33-4c70-9c27-1e20053a6beb tempest-VolumesTestJSON-326027331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:12:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-38752b8d-6c33-4c70-9c27-1e20053a6beb tempest-VolumesTestJSON-326027331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:09 devstack sudo[99377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:12:09 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e42fe682-accb-415a-8013-c852d51f7f68 tempest-SnapshotDependencyTests-1051766090 None] Acquiring lock "cinder-quobyte-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e42fe682-accb-415a-8013-c852d51f7f68 tempest-SnapshotDependencyTests-1051766090 None] Lock "cinder-quobyte-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d" acquired by "delete_volume" :: waited 0.028s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:09 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f3ef98-362d-4ee7-a664-0ff67211c4ea]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e42fe682-accb-415a-8013-c852d51f7f68 tempest-SnapshotDependencyTests-1051766090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:10 devstack sudo[99382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d
Jul 03 13:12:10 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:10 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6205b5bb-0e52-4074-98de-35ab3e76638b_4j8vz0o6" returned: 1 in 1.015s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6205b5bb-0e52-4074-98de-35ab3e76638b_4j8vz0o6' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:12:10 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75de50c-97c6-47e5-bfbd-80905c501843]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_4hd64tjldevstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:10 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8595f417-5ba8-4f7a-a2e9-71370687687b tempest-VolumesTestJSON-326027331 None] Acquiring lock "cinder-7d42f25d-9396-447d-96f4-75c624e8c2b5-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:10 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8595f417-5ba8-4f7a-a2e9-71370687687b tempest-VolumesTestJSON-326027331 None] Lock "cinder-7d42f25d-9396-447d-96f4-75c624e8c2b5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:10 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a5710339-e88d-4722-9eca-09ee69150fae tempest-SnapshotsActionsTest-414207452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.1560c67a-47e8-4828-9e84-15a96c348ccf 1G" returned: 0 in 1.109s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a5710339-e88d-4722-9eca-09ee69150fae tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.1560c67a-47e8-4828-9e84-15a96c348ccf {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:10 devstack sudo[99387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.1560c67a-47e8-4828-9e84-15a96c348ccf
Jul 03 13:12:10 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:10 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8595f417-5ba8-4f7a-a2e9-71370687687b tempest-VolumesTestJSON-326027331 None] Acquiring lock "cinder-quobyte-7d42f25d-9396-447d-96f4-75c624e8c2b5" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:10 devstack sudo[99386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_4hd64tjldevstack@QuobyteHD
Jul 03 13:12:10 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:10 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8595f417-5ba8-4f7a-a2e9-71370687687b tempest-VolumesTestJSON-326027331 None] Lock "cinder-quobyte-7d42f25d-9396-447d-96f4-75c624e8c2b5" acquired by "delete_volume" :: waited 0.042s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:10 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[db777ee6-0a42-4aea-af47-6a8bfd6e3501]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8595f417-5ba8-4f7a-a2e9-71370687687b tempest-VolumesTestJSON-326027331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d42f25d-9396-447d-96f4-75c624e8c2b5 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:10 devstack sudo[99390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d42f25d-9396-447d-96f4-75c624e8c2b5
Jul 03 13:12:10 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:10 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-38752b8d-6c33-4c70-9c27-1e20053a6beb tempest-VolumesTestJSON-326027331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.048s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:10 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-38752b8d-6c33-4c70-9c27-1e20053a6beb tempest-VolumesTestJSON-326027331 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:12:10 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-38752b8d-6c33-4c70-9c27-1e20053a6beb tempest-VolumesTestJSON-326027331 None] Deleted volume successfully.
Jul 03 13:12:10 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:10 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-38752b8d-6c33-4c70-9c27-1e20053a6beb tempest-VolumesTestJSON-326027331 None] Lock "cinder-b51349b0-cab8-43a9-be02-8692abb9dd62-delete_volume" released by "delete_volume" :: held 3.253s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e42fe682-accb-415a-8013-c852d51f7f68 tempest-SnapshotDependencyTests-1051766090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d" returned: 0 in 1.000s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e42fe682-accb-415a-8013-c852d51f7f68 tempest-SnapshotDependencyTests-1051766090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:11 devstack sudo[99396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d
Jul 03 13:12:11 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:11 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_4hd64tjldevstack@QuobyteHD" returned: 0 in 1.038s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:11 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] 6205b5bb-0e52-4074-98de-35ab3e76638b was qcow2, converting to raw {{(pid=86837) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 03 13:12:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_4hd64tjldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:11 devstack sudo[99405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_4hd64tjldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11
Jul 03 13:12:11 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:11 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a5710339-e88d-4722-9eca-09ee69150fae tempest-SnapshotsActionsTest-414207452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.1560c67a-47e8-4828-9e84-15a96c348ccf" returned: 0 in 1.073s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:11 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-a5710339-e88d-4722-9eca-09ee69150fae tempest-SnapshotsActionsTest-414207452 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.1560c67a-47e8-4828-9e84-15a96c348ccf is being set with open permissions: ugo+rw
Jul 03 13:12:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a5710339-e88d-4722-9eca-09ee69150fae tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.1560c67a-47e8-4828-9e84-15a96c348ccf {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:11 devstack sudo[99407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.1560c67a-47e8-4828-9e84-15a96c348ccf
Jul 03 13:12:11 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:11 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8595f417-5ba8-4f7a-a2e9-71370687687b tempest-VolumesTestJSON-326027331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d42f25d-9396-447d-96f4-75c624e8c2b5" returned: 0 in 1.163s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8595f417-5ba8-4f7a-a2e9-71370687687b tempest-VolumesTestJSON-326027331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d42f25d-9396-447d-96f4-75c624e8c2b5 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:11 devstack sudo[99412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d42f25d-9396-447d-96f4-75c624e8c2b5
Jul 03 13:12:11 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:11 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e42fe682-accb-415a-8013-c852d51f7f68 tempest-SnapshotDependencyTests-1051766090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d" returned: 0 in 0.833s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:11 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e42fe682-accb-415a-8013-c852d51f7f68 tempest-SnapshotDependencyTests-1051766090 None] Lock "cinder-quobyte-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d" released by "delete_volume" :: held 1.905s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:11 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-e42fe682-accb-415a-8013-c852d51f7f68 tempest-SnapshotDependencyTests-1051766090 None] Created reservations ['f91d8c5b-72e9-4385-ad87-c5bfb629a829', 'cb16d086-e030-4a28-9d0b-9f8d86203bca', 'e9e38136-8dc5-43df-9bea-a56620d15ef1', '134ce8a6-80f3-4bf7-9172-9ad0adb516db'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:12:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e42fe682-accb-415a-8013-c852d51f7f68 tempest-SnapshotDependencyTests-1051766090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:12:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e42fe682-accb-415a-8013-c852d51f7f68 tempest-SnapshotDependencyTests-1051766090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:12:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e42fe682-accb-415a-8013-c852d51f7f68 tempest-SnapshotDependencyTests-1051766090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:12:12 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e42fe682-accb-415a-8013-c852d51f7f68 tempest-SnapshotDependencyTests-1051766090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:12:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e42fe682-accb-415a-8013-c852d51f7f68 tempest-SnapshotDependencyTests-1051766090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:12:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e42fe682-accb-415a-8013-c852d51f7f68 tempest-SnapshotDependencyTests-1051766090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:12 devstack sudo[99415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:12:12 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9222e999-868d-4c78-a129-0001c2978892 tempest-SnapshotDependencyTests-1051766090 None] Acquiring lock "cinder-b856adaa-eb03-4213-9a7b-42d1f6969e45-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9222e999-868d-4c78-a129-0001c2978892 tempest-SnapshotDependencyTests-1051766090 None] Lock "cinder-b856adaa-eb03-4213-9a7b-42d1f6969e45-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9222e999-868d-4c78-a129-0001c2978892 tempest-SnapshotDependencyTests-1051766090 None] Acquiring lock "cinder-quobyte-b856adaa-eb03-4213-9a7b-42d1f6969e45" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9222e999-868d-4c78-a129-0001c2978892 tempest-SnapshotDependencyTests-1051766090 None] Lock "cinder-quobyte-b856adaa-eb03-4213-9a7b-42d1f6969e45" acquired by "delete_volume" :: waited 0.024s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:12 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a5710339-e88d-4722-9eca-09ee69150fae tempest-SnapshotsActionsTest-414207452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.1560c67a-47e8-4828-9e84-15a96c348ccf" returned: 0 in 0.913s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:12 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0da5078-905f-4ba4-a597-4eabdea922c8]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9222e999-868d-4c78-a129-0001c2978892 tempest-SnapshotDependencyTests-1051766090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b856adaa-eb03-4213-9a7b-42d1f6969e45 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a5710339-e88d-4722-9eca-09ee69150fae tempest-SnapshotsActionsTest-414207452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.312s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:12:12 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-a5710339-e88d-4722-9eca-09ee69150fae tempest-SnapshotsActionsTest-414207452 None] Create snapshot completed successfully
Jul 03 13:12:12 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8595f417-5ba8-4f7a-a2e9-71370687687b tempest-VolumesTestJSON-326027331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d42f25d-9396-447d-96f4-75c624e8c2b5" returned: 0 in 0.836s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:12 devstack sudo[99428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b856adaa-eb03-4213-9a7b-42d1f6969e45
Jul 03 13:12:12 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8595f417-5ba8-4f7a-a2e9-71370687687b tempest-VolumesTestJSON-326027331 None] Lock "cinder-quobyte-7d42f25d-9396-447d-96f4-75c624e8c2b5" released by "delete_volume" :: held 2.099s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:12 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-8595f417-5ba8-4f7a-a2e9-71370687687b tempest-VolumesTestJSON-326027331 None] Created reservations ['fea783db-09c5-4a3d-bfb5-f36de933c019', '2990d851-d279-493b-98cf-7a27ea4e55a5', '29140455-c763-4635-bb6f-21d72737634a', 'd35d5230-8745-4619-9132-1560a70d7730'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:12:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8595f417-5ba8-4f7a-a2e9-71370687687b tempest-VolumesTestJSON-326027331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:12:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8595f417-5ba8-4f7a-a2e9-71370687687b tempest-VolumesTestJSON-326027331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:12:12 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8595f417-5ba8-4f7a-a2e9-71370687687b tempest-VolumesTestJSON-326027331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:12:12 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8595f417-5ba8-4f7a-a2e9-71370687687b tempest-VolumesTestJSON-326027331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:12:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8595f417-5ba8-4f7a-a2e9-71370687687b tempest-VolumesTestJSON-326027331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:12:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8595f417-5ba8-4f7a-a2e9-71370687687b tempest-VolumesTestJSON-326027331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:12 devstack sudo[99433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:12:12 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9cd4a731-52c6-466c-998c-1e2f98d7f1c1 tempest-SnapshotsActionsTest-661415319 None] Acquiring lock "cinder-1560c67a-47e8-4828-9e84-15a96c348ccf-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9cd4a731-52c6-466c-998c-1e2f98d7f1c1 tempest-SnapshotsActionsTest-661415319 None] Lock "cinder-1560c67a-47e8-4828-9e84-15a96c348ccf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9cd4a731-52c6-466c-998c-1e2f98d7f1c1 tempest-SnapshotsActionsTest-661415319 None] Acquiring lock "cinder-quobyte-e7184d0a-0b90-4316-880f-f2c5125f768d" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:13 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e42fe682-accb-415a-8013-c852d51f7f68 tempest-SnapshotDependencyTests-1051766090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.031s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:13 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-e42fe682-accb-415a-8013-c852d51f7f68 tempest-SnapshotDependencyTests-1051766090 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:12:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9cd4a731-52c6-466c-998c-1e2f98d7f1c1 tempest-SnapshotsActionsTest-661415319 None] Lock "cinder-quobyte-e7184d0a-0b90-4316-880f-f2c5125f768d" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9cd4a731-52c6-466c-998c-1e2f98d7f1c1 tempest-SnapshotsActionsTest-661415319 None] Acquiring lock "cinder-quobyte-1560c67a-47e8-4828-9e84-15a96c348ccf" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:13 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-e42fe682-accb-415a-8013-c852d51f7f68 tempest-SnapshotDependencyTests-1051766090 None] Deleted volume successfully.
Jul 03 13:12:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9cd4a731-52c6-466c-998c-1e2f98d7f1c1 tempest-SnapshotsActionsTest-661415319 None] Lock "cinder-quobyte-1560c67a-47e8-4828-9e84-15a96c348ccf" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:13 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-9cd4a731-52c6-466c-998c-1e2f98d7f1c1 tempest-SnapshotsActionsTest-661415319 None] Deleting offline snapshot 1560c67a-47e8-4828-9e84-15a96c348ccf of volume e7184d0a-0b90-4316-880f-f2c5125f768d {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:12:13 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-9cd4a731-52c6-466c-998c-1e2f98d7f1c1 tempest-SnapshotsActionsTest-661415319 None] snapshot_file for this snap is: volume-e7184d0a-0b90-4316-880f-f2c5125f768d.1560c67a-47e8-4828-9e84-15a96c348ccf {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:12:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e42fe682-accb-415a-8013-c852d51f7f68 tempest-SnapshotDependencyTests-1051766090 None] Lock "cinder-6d743c2c-08e3-4a0e-89ab-3d5ecba6ba4d-delete_volume" released by "delete_volume" :: held 3.335s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:13 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ac5746-d0c2-4c3a-b2e4-1191816a532c]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9cd4a731-52c6-466c-998c-1e2f98d7f1c1 tempest-SnapshotsActionsTest-661415319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.1560c67a-47e8-4828-9e84-15a96c348ccf {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:13 devstack sudo[99435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.1560c67a-47e8-4828-9e84-15a96c348ccf
Jul 03 13:12:13 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:13 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:13 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8595f417-5ba8-4f7a-a2e9-71370687687b tempest-VolumesTestJSON-326027331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.764s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9222e999-868d-4c78-a129-0001c2978892 tempest-SnapshotDependencyTests-1051766090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b856adaa-eb03-4213-9a7b-42d1f6969e45" returned: 0 in 1.279s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:13 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-8595f417-5ba8-4f7a-a2e9-71370687687b tempest-VolumesTestJSON-326027331 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:12:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9222e999-868d-4c78-a129-0001c2978892 tempest-SnapshotDependencyTests-1051766090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b856adaa-eb03-4213-9a7b-42d1f6969e45 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:13 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-8595f417-5ba8-4f7a-a2e9-71370687687b tempest-VolumesTestJSON-326027331 None] Deleted volume successfully.
Jul 03 13:12:13 devstack sudo[99443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b856adaa-eb03-4213-9a7b-42d1f6969e45
Jul 03 13:12:13 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8595f417-5ba8-4f7a-a2e9-71370687687b tempest-VolumesTestJSON-326027331 None] Lock "cinder-7d42f25d-9396-447d-96f4-75c624e8c2b5-delete_volume" released by "delete_volume" :: held 3.393s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c7d417fa-8034-4f15-828e-1438f42367d3 tempest-VolumesTestJSON-326027331 None] Acquiring lock "cinder-de14a686-ba12-4e18-ab9f-317fc4d769ab-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c7d417fa-8034-4f15-828e-1438f42367d3 tempest-VolumesTestJSON-326027331 None] Lock "cinder-de14a686-ba12-4e18-ab9f-317fc4d769ab-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c7d417fa-8034-4f15-828e-1438f42367d3 tempest-VolumesTestJSON-326027331 None] Acquiring lock "cinder-quobyte-de14a686-ba12-4e18-ab9f-317fc4d769ab" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c7d417fa-8034-4f15-828e-1438f42367d3 tempest-VolumesTestJSON-326027331 None] Lock "cinder-quobyte-de14a686-ba12-4e18-ab9f-317fc4d769ab" acquired by "delete_volume" :: waited 0.025s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:13 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71564ae-ad7f-4f57-9f19-f637b3c63de9]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c7d417fa-8034-4f15-828e-1438f42367d3 tempest-VolumesTestJSON-326027331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-de14a686-ba12-4e18-ab9f-317fc4d769ab {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:14 devstack sudo[99445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-de14a686-ba12-4e18-ab9f-317fc4d769ab
Jul 03 13:12:14 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:14 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_4hd64tjldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11" returned: 0 in 2.928s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:14 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:14 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_4hd64tjldevstack@QuobyteHD, size 112.00 MB, duration 2.93 sec, destination /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11 {{(pid=86837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 13:12:14 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Converted 112.00 MB image at 38.23 MB/s
Jul 03 13:12:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9cd4a731-52c6-466c-998c-1e2f98d7f1c1 tempest-SnapshotsActionsTest-661415319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.1560c67a-47e8-4828-9e84-15a96c348ccf" returned: 0 in 1.081s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-9cd4a731-52c6-466c-998c-1e2f98d7f1c1 tempest-SnapshotsActionsTest-661415319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7184d0a-0b90-4316-880f-f2c5125f768d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:12:14 devstack sudo[99451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11 1G
Jul 03 13:12:14 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:14 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f84f99e-a710-4a0c-ae4f-56bc0bad856f]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9cd4a731-52c6-466c-998c-1e2f98d7f1c1 tempest-SnapshotsActionsTest-661415319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:14 devstack sudo[99453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936
Jul 03 13:12:14 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:14 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9222e999-868d-4c78-a129-0001c2978892 tempest-SnapshotDependencyTests-1051766090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b856adaa-eb03-4213-9a7b-42d1f6969e45" returned: 0 in 0.903s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9222e999-868d-4c78-a129-0001c2978892 tempest-SnapshotDependencyTests-1051766090 None] Lock "cinder-quobyte-b856adaa-eb03-4213-9a7b-42d1f6969e45" released by "delete_volume" :: held 2.245s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:14 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-9222e999-868d-4c78-a129-0001c2978892 tempest-SnapshotDependencyTests-1051766090 None] Created reservations ['3de4ef15-aaa7-448f-a497-0e11ae090ddd', '6d26f64c-7193-4d85-8aea-f147fdc841fa', '56ab173f-8ffd-4b1b-b64d-95c34f38c5cf', 'ffdd3b26-f530-4974-80ae-b4c0c92bf1b9'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:12:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9222e999-868d-4c78-a129-0001c2978892 tempest-SnapshotDependencyTests-1051766090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:12:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9222e999-868d-4c78-a129-0001c2978892 tempest-SnapshotDependencyTests-1051766090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:12:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9222e999-868d-4c78-a129-0001c2978892 tempest-SnapshotDependencyTests-1051766090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:12:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9222e999-868d-4c78-a129-0001c2978892 tempest-SnapshotDependencyTests-1051766090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:12:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9222e999-868d-4c78-a129-0001c2978892 tempest-SnapshotDependencyTests-1051766090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:12:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9222e999-868d-4c78-a129-0001c2978892 tempest-SnapshotDependencyTests-1051766090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:14 devstack sudo[99460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:12:14 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:14 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c7d417fa-8034-4f15-828e-1438f42367d3 tempest-VolumesTestJSON-326027331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-de14a686-ba12-4e18-ab9f-317fc4d769ab" returned: 0 in 0.897s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c7d417fa-8034-4f15-828e-1438f42367d3 tempest-VolumesTestJSON-326027331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-de14a686-ba12-4e18-ab9f-317fc4d769ab {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:14 devstack sudo[99464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-de14a686-ba12-4e18-ab9f-317fc4d769ab
Jul 03 13:12:14 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:12:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:12:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:12:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:12:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:12:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:12:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:15 devstack sudo[99467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:12:15 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:15 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11 1G" returned: 0 in 0.935s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:15 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[958c428f-6897-44b9-8883-341c64605c53]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:15 devstack sudo[99472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11
Jul 03 13:12:15 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:15 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9cd4a731-52c6-466c-998c-1e2f98d7f1c1 tempest-SnapshotsActionsTest-661415319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936" returned: 0 in 1.073s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:15 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-9cd4a731-52c6-466c-998c-1e2f98d7f1c1 tempest-SnapshotsActionsTest-661415319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7184d0a-0b90-4316-880f-f2c5125f768d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:12:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9cd4a731-52c6-466c-998c-1e2f98d7f1c1 tempest-SnapshotsActionsTest-661415319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.1560c67a-47e8-4828-9e84-15a96c348ccf {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:15 devstack sudo[99474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.1560c67a-47e8-4828-9e84-15a96c348ccf
Jul 03 13:12:15 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:15 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9222e999-868d-4c78-a129-0001c2978892 tempest-SnapshotDependencyTests-1051766090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.957s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:15 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-9222e999-868d-4c78-a129-0001c2978892 tempest-SnapshotDependencyTests-1051766090 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:12:15 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-9222e999-868d-4c78-a129-0001c2978892 tempest-SnapshotDependencyTests-1051766090 None] Deleted volume successfully.
Jul 03 13:12:15 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9222e999-868d-4c78-a129-0001c2978892 tempest-SnapshotDependencyTests-1051766090 None] Lock "cinder-b856adaa-eb03-4213-9a7b-42d1f6969e45-delete_volume" released by "delete_volume" :: held 3.532s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:15 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c7d417fa-8034-4f15-828e-1438f42367d3 tempest-VolumesTestJSON-326027331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-de14a686-ba12-4e18-ab9f-317fc4d769ab" returned: 0 in 1.038s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:15 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c7d417fa-8034-4f15-828e-1438f42367d3 tempest-VolumesTestJSON-326027331 None] Lock "cinder-quobyte-de14a686-ba12-4e18-ab9f-317fc4d769ab" released by "delete_volume" :: held 2.025s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:15 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.985s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:15 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:12:15 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:12:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 28 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:12:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>, <Thread(tpool_thread_0, started daemon 134850092431040)>, <Thread(tpool_thread_1, started daemon 134850084021952)>, <Thread(tpool_thread_2, started daemon 134850075612864)>, <Thread(tpool_thread_3, started daemon 134850067203776)>, <Thread(tpool_thread_4, started daemon 134850058794688)>, <Thread(tpool_thread_5, started daemon 134850050385600)>, <Thread(tpool_thread_6, started daemon 134850041976512)>, <Thread(tpool_thread_7, started daemon 134850033567424)>, <Thread(tpool_thread_8, started daemon 134850025158336)>, <Thread(tpool_thread_9, started daemon 134850016749248)>, <Thread(tpool_thread_10, started daemon 134850008340160)>, <Thread(tpool_thread_11, started daemon 134849999931072)>, <Thread(tpool_thread_12, started daemon 134849991521984)>, <Thread(tpool_thread_13, started daemon 134849983112896)>, <Thread(tpool_thread_14, started daemon 134849974703808)>, <Thread(tpool_thread_15, started daemon 134849966294720)>, <Thread(tpool_thread_16, started daemon 134849957885632)>, <Thread(tpool_thread_17, started daemon 134849949476544)>, <Thread(tpool_thread_18, started daemon 134849941067456)>, <Thread(tpool_thread_19, started daemon 134849932658368)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:12:16 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-c7d417fa-8034-4f15-828e-1438f42367d3 tempest-VolumesTestJSON-326027331 None] Created reservations ['588c0b73-a493-4f7c-aff7-3de5c565b03e', 'ab186f40-f20d-4709-9bae-e73a286d3008', 'ecbd667e-c9fc-4ae2-bd2b-326f071d45f0', '597ea8af-dc97-4476-8576-c2e05eede7b2'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:12:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c7d417fa-8034-4f15-828e-1438f42367d3 tempest-VolumesTestJSON-326027331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:12:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c7d417fa-8034-4f15-828e-1438f42367d3 tempest-VolumesTestJSON-326027331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:12:16 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c7d417fa-8034-4f15-828e-1438f42367d3 tempest-VolumesTestJSON-326027331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:12:16 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c7d417fa-8034-4f15-828e-1438f42367d3 tempest-VolumesTestJSON-326027331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:12:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c7d417fa-8034-4f15-828e-1438f42367d3 tempest-VolumesTestJSON-326027331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:12:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c7d417fa-8034-4f15-828e-1438f42367d3 tempest-VolumesTestJSON-326027331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:16 devstack sudo[99479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:12:16 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:16 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11" returned: 0 in 1.145s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:16 devstack sudo[99487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11
Jul 03 13:12:16 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:16 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9cd4a731-52c6-466c-998c-1e2f98d7f1c1 tempest-SnapshotsActionsTest-661415319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.1560c67a-47e8-4828-9e84-15a96c348ccf" returned: 0 in 1.168s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9cd4a731-52c6-466c-998c-1e2f98d7f1c1 tempest-SnapshotsActionsTest-661415319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.1560c67a-47e8-4828-9e84-15a96c348ccf {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:16 devstack sudo[99489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.1560c67a-47e8-4828-9e84-15a96c348ccf
Jul 03 13:12:16 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:16 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c7d417fa-8034-4f15-828e-1438f42367d3 tempest-VolumesTestJSON-326027331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.839s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:16 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-c7d417fa-8034-4f15-828e-1438f42367d3 tempest-VolumesTestJSON-326027331 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:12:16 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-c7d417fa-8034-4f15-828e-1438f42367d3 tempest-VolumesTestJSON-326027331 None] Deleted volume successfully.
Jul 03 13:12:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c7d417fa-8034-4f15-828e-1438f42367d3 tempest-VolumesTestJSON-326027331 None] Lock "cinder-de14a686-ba12-4e18-ab9f-317fc4d769ab-delete_volume" released by "delete_volume" :: held 3.233s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:17 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9cd4a731-52c6-466c-998c-1e2f98d7f1c1 tempest-SnapshotsActionsTest-661415319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.1560c67a-47e8-4828-9e84-15a96c348ccf" returned: 0 in 0.771s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9cd4a731-52c6-466c-998c-1e2f98d7f1c1 tempest-SnapshotsActionsTest-661415319 None] Lock "cinder-quobyte-1560c67a-47e8-4828-9e84-15a96c348ccf" released by "_delete_snapshot" :: held 4.243s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9cd4a731-52c6-466c-998c-1e2f98d7f1c1 tempest-SnapshotsActionsTest-661415319 None] Lock "cinder-quobyte-e7184d0a-0b90-4316-880f-f2c5125f768d" released by "delete_snapshot" :: held 4.297s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:17 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-9cd4a731-52c6-466c-998c-1e2f98d7f1c1 tempest-SnapshotsActionsTest-661415319 None] Created reservations ['bb20b0ae-3cd3-4b77-b013-fa43e18abab2', '83adef38-7e4c-4028-8ed3-fd39f42e23d1', 'ca7d8a3e-bd4c-4089-a402-9fc908e150c9', '8722d498-97bf-4103-8fa2-f4f62f5115d1'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:12:17 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-9cd4a731-52c6-466c-998c-1e2f98d7f1c1 tempest-SnapshotsActionsTest-661415319 None] Delete snapshot completed successfully.
Jul 03 13:12:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9cd4a731-52c6-466c-998c-1e2f98d7f1c1 tempest-SnapshotsActionsTest-661415319 None] Lock "cinder-1560c67a-47e8-4828-9e84-15a96c348ccf-delete_snapshot" released by "delete_snapshot" :: held 4.502s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:17 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11" returned: 1 in 1.179s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:12:17 devstack cinder-volume[86837]: DEBUG cinder.volume.volume_utils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Downloaded image 6205b5bb-0e52-4074-98de-35ab3e76638b ((None, [{'url': 'file:///opt/stack/data/glance/images/6205b5bb-0e52-4074-98de-35ab3e76638b', 'metadata': {}}])) to volume b3d355ad-c940-4b17-ab80-843d3c522d11 successfully. {{(pid=86837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 03 13:12:17 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Temporary image 6205b5bb-0e52-4074-98de-35ab3e76638b for user 97064b55755d41f1849fde163b43474a is deleted. {{(pid=86837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 03 13:12:17 devstack cinder-volume[86837]: DEBUG cinder.volume.volume_utils [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Marking volume b3d355ad-c940-4b17-ab80-843d3c522d11 as bootable. {{(pid=86837) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 03 13:12:17 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Copying metadata from image 6205b5bb-0e52-4074-98de-35ab3e76638b to b3d355ad-c940-4b17-ab80-843d3c522d11. {{(pid=86837) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 13:12:17 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Creating volume glance metadata for volume b3d355ad-c940-4b17-ab80-843d3c522d11 backed by image 6205b5bb-0e52-4074-98de-35ab3e76638b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6205b5bb-0e52-4074-98de-35ab3e76638b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86837) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 13:12:17 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00c74880-8fcd-42e6-895d-4f192e3c3ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3d355ad-c940-4b17-ab80-843d3c522d11', 'volume_size': 1, 'image_id': '6205b5bb-0e52-4074-98de-35ab3e76638b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6205b5bb-0e52-4074-98de-35ab3e76638b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c125c5701081483fb4d62cc48d112711', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6205b5bb-0e52-4074-98de-35ab3e76638b', 'created_at': datetime.datetime(2026, 7, 3, 10, 50, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 50, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6205b5bb-0e52-4074-98de-35ab3e76638b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7aa53be32d50>}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:12:17 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd7da603-0e5a-424d-8989-8555e9b583b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:12:17 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Volume volume-b3d355ad-c940-4b17-ab80-843d3c522d11 (b3d355ad-c940-4b17-ab80-843d3c522d11): created successfully
Jul 03 13:12:17 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd7da603-0e5a-424d-8989-8555e9b583b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:12:17 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Flow 'volume_create_manager' (fdd25716-6e71-4a39-acb0-c858da869062) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:12:17 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-a6e639be-07ad-4213-92a7-0dd556683941 tempest-VolumesGetTest-1922388409 None] Created volume successfully.
Jul 03 13:12:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-60535bb6-69c0-4f56-9628-ae4ce134d187 tempest-SnapshotsActionsTest-414207452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:12:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-60535bb6-69c0-4f56-9628-ae4ce134d187 tempest-SnapshotsActionsTest-414207452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:12:18 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-60535bb6-69c0-4f56-9628-ae4ce134d187 tempest-SnapshotsActionsTest-414207452 None] Creating offline snapshot 3d03526f-5271-4be7-a353-62be09e15472 of volume e7184d0a-0b90-4316-880f-f2c5125f768d {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:12:18 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1d369c-f89c-4930-85e8-63ea6609a292]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-60535bb6-69c0-4f56-9628-ae4ce134d187 tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:19 devstack sudo[99534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936
Jul 03 13:12:19 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:19 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:12:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Flow 'volume_create_manager' (61a33c39-bec1-4771-a559-c3041ff9d8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:12:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368115e6-84ff-429a-bc9f-f4c3027391b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:12:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368115e6-84ff-429a-bc9f-f4c3027391b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:12:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-668341070',display_name='tempest-VolumesGetTest-Volume-1535485507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23461dd6-d73f-43c2-99e5-4f13a11149ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41f3d519e48d44dfa81cc5bd48f8acee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:12:19Z,use_quota=True,user_id='97064b55755d41f1849fde163b43474a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:12:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433e9698-cd08-49fb-8a19-16a6c26ecd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:12:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433e9698-cd08-49fb-8a19-16a6c26ecd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:12:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8b09ad-d425-40d0-8701-358dc32994ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:12:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8b09ad-d425-40d0-8701-358dc32994ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23461dd6-d73f-43c2-99e5-4f13a11149ee', 'volume_name': 'volume-23461dd6-d73f-43c2-99e5-4f13a11149ee', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:12:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a9a6cc-d165-485f-8a89-468981d7f1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:12:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a9a6cc-d165-485f-8a89-468981d7f1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:12:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14687018-0dbc-45d1-a942-fe44e3e5a260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:12:19 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Volume 23461dd6-d73f-43c2-99e5-4f13a11149ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23461dd6-d73f-43c2-99e5-4f13a11149ee', 'volume_size': 1}
Jul 03 13:12:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:12:20 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-60535bb6-69c0-4f56-9628-ae4ce134d187 tempest-SnapshotsActionsTest-414207452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936" returned: 0 in 1.174s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:20 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-60535bb6-69c0-4f56-9628-ae4ce134d187 tempest-SnapshotsActionsTest-414207452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7184d0a-0b90-4316-880f-f2c5125f768d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:12:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-60535bb6-69c0-4f56-9628-ae4ce134d187 tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.3d03526f-5271-4be7-a353-62be09e15472 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:20 devstack sudo[99540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.3d03526f-5271-4be7-a353-62be09e15472 1G
Jul 03 13:12:20 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:21 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-60535bb6-69c0-4f56-9628-ae4ce134d187 tempest-SnapshotsActionsTest-414207452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.3d03526f-5271-4be7-a353-62be09e15472 1G" returned: 0 in 1.188s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-60535bb6-69c0-4f56-9628-ae4ce134d187 tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.3d03526f-5271-4be7-a353-62be09e15472 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:21 devstack sudo[99547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.3d03526f-5271-4be7-a353-62be09e15472
Jul 03 13:12:21 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:22 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-60535bb6-69c0-4f56-9628-ae4ce134d187 tempest-SnapshotsActionsTest-414207452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.3d03526f-5271-4be7-a353-62be09e15472" returned: 0 in 0.817s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:22 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-60535bb6-69c0-4f56-9628-ae4ce134d187 tempest-SnapshotsActionsTest-414207452 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.3d03526f-5271-4be7-a353-62be09e15472 is being set with open permissions: ugo+rw
Jul 03 13:12:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-60535bb6-69c0-4f56-9628-ae4ce134d187 tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.3d03526f-5271-4be7-a353-62be09e15472 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:22 devstack sudo[99552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.3d03526f-5271-4be7-a353-62be09e15472
Jul 03 13:12:22 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:22 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-60535bb6-69c0-4f56-9628-ae4ce134d187 tempest-SnapshotsActionsTest-414207452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.3d03526f-5271-4be7-a353-62be09e15472" returned: 0 in 0.708s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-60535bb6-69c0-4f56-9628-ae4ce134d187 tempest-SnapshotsActionsTest-414207452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.027s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:12:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.184s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:12:22 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:12:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-668341070',display_name='tempest-VolumesGetTest-Volume-1535485507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23461dd6-d73f-43c2-99e5-4f13a11149ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41f3d519e48d44dfa81cc5bd48f8acee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:12:19Z,use_quota=True,user_id='97064b55755d41f1849fde163b43474a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:12:22 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Creating volume 23461dd6-d73f-43c2-99e5-4f13a11149ee {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:12:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:12:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:12:22 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:12:22 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:12:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:12:22 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:12:22 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:12:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23461dd6-d73f-43c2-99e5-4f13a11149ee 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:22 devstack sudo[99563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23461dd6-d73f-43c2-99e5-4f13a11149ee 1073741824
Jul 03 13:12:22 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:22 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-60535bb6-69c0-4f56-9628-ae4ce134d187 tempest-SnapshotsActionsTest-414207452 None] Create snapshot completed successfully
Jul 03 13:12:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-743975ec-539c-4625-b847-13deabe1d816 tempest-BackendsCapabilitiesAdminTestsJSON-1540948887 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5812377929688, 'free_capacity_gb': 1775.5812377929688, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86837) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 03 13:12:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a714aa76-0c89-497c-aa2e-abf66bf181b5 tempest-SnapshotsActionsTest-661415319 None] Acquiring lock "cinder-3d03526f-5271-4be7-a353-62be09e15472-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a714aa76-0c89-497c-aa2e-abf66bf181b5 tempest-SnapshotsActionsTest-661415319 None] Lock "cinder-3d03526f-5271-4be7-a353-62be09e15472-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a714aa76-0c89-497c-aa2e-abf66bf181b5 tempest-SnapshotsActionsTest-661415319 None] Acquiring lock "cinder-quobyte-e7184d0a-0b90-4316-880f-f2c5125f768d" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a714aa76-0c89-497c-aa2e-abf66bf181b5 tempest-SnapshotsActionsTest-661415319 None] Lock "cinder-quobyte-e7184d0a-0b90-4316-880f-f2c5125f768d" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a714aa76-0c89-497c-aa2e-abf66bf181b5 tempest-SnapshotsActionsTest-661415319 None] Acquiring lock "cinder-quobyte-3d03526f-5271-4be7-a353-62be09e15472" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a714aa76-0c89-497c-aa2e-abf66bf181b5 tempest-SnapshotsActionsTest-661415319 None] Lock "cinder-quobyte-3d03526f-5271-4be7-a353-62be09e15472" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-a714aa76-0c89-497c-aa2e-abf66bf181b5 tempest-SnapshotsActionsTest-661415319 None] Deleting offline snapshot 3d03526f-5271-4be7-a353-62be09e15472 of volume e7184d0a-0b90-4316-880f-f2c5125f768d {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:12:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-a714aa76-0c89-497c-aa2e-abf66bf181b5 tempest-SnapshotsActionsTest-661415319 None] snapshot_file for this snap is: volume-e7184d0a-0b90-4316-880f-f2c5125f768d.3d03526f-5271-4be7-a353-62be09e15472 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:12:23 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e9294b-380f-476a-968e-aa41ddaba96f]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a714aa76-0c89-497c-aa2e-abf66bf181b5 tempest-SnapshotsActionsTest-661415319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.3d03526f-5271-4be7-a353-62be09e15472 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:23 devstack sudo[99565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.3d03526f-5271-4be7-a353-62be09e15472
Jul 03 13:12:23 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-39f195f7-bcec-4f40-b609-fc514807483d tempest-BackendsCapabilitiesAdminTestsJSON-1540948887 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5812377929688, 'free_capacity_gb': 1775.5812377929688, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86837) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 03 13:12:23 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23461dd6-d73f-43c2-99e5-4f13a11149ee 1073741824" returned: 0 in 1.091s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23461dd6-d73f-43c2-99e5-4f13a11149ee {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:24 devstack sudo[99570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23461dd6-d73f-43c2-99e5-4f13a11149ee
Jul 03 13:12:24 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:24 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a714aa76-0c89-497c-aa2e-abf66bf181b5 tempest-SnapshotsActionsTest-661415319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.3d03526f-5271-4be7-a353-62be09e15472" returned: 0 in 0.995s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-a714aa76-0c89-497c-aa2e-abf66bf181b5 tempest-SnapshotsActionsTest-661415319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7184d0a-0b90-4316-880f-f2c5125f768d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:12:24 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[504b7e9b-31b5-4ee8-ac2c-f8b3034bdfde]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a714aa76-0c89-497c-aa2e-abf66bf181b5 tempest-SnapshotsActionsTest-661415319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:24 devstack sudo[99575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936
Jul 03 13:12:24 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:25 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23461dd6-d73f-43c2-99e5-4f13a11149ee" returned: 0 in 1.111s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] <== create_volume: return (2266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:12:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.270s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:12:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14687018-0dbc-45d1-a942-fe44e3e5a260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23461dd6-d73f-43c2-99e5-4f13a11149ee', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:12:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98341a35-6c77-4c92-93fd-f09555c8e13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:12:25 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Volume volume-23461dd6-d73f-43c2-99e5-4f13a11149ee (23461dd6-d73f-43c2-99e5-4f13a11149ee): created successfully
Jul 03 13:12:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98341a35-6c77-4c92-93fd-f09555c8e13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:12:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Flow 'volume_create_manager' (61a33c39-bec1-4771-a559-c3041ff9d8b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:12:25 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-49628f55-9fdc-4bcd-9d70-66041d6f2410 tempest-VolumesGetTest-1922388409 None] Created volume successfully.
Jul 03 13:12:25 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a714aa76-0c89-497c-aa2e-abf66bf181b5 tempest-SnapshotsActionsTest-661415319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936" returned: 0 in 1.172s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-a714aa76-0c89-497c-aa2e-abf66bf181b5 tempest-SnapshotsActionsTest-661415319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7184d0a-0b90-4316-880f-f2c5125f768d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:12:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a714aa76-0c89-497c-aa2e-abf66bf181b5 tempest-SnapshotsActionsTest-661415319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.3d03526f-5271-4be7-a353-62be09e15472 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:25 devstack sudo[99583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.3d03526f-5271-4be7-a353-62be09e15472
Jul 03 13:12:25 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:26 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8ba8ac5d-4e20-474d-abf7-bfab90aa76e7 tempest-VolumesGetTest-1922388409 None] Acquiring lock "cinder-23461dd6-d73f-43c2-99e5-4f13a11149ee-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:26 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8ba8ac5d-4e20-474d-abf7-bfab90aa76e7 tempest-VolumesGetTest-1922388409 None] Lock "cinder-23461dd6-d73f-43c2-99e5-4f13a11149ee-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:26 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8ba8ac5d-4e20-474d-abf7-bfab90aa76e7 tempest-VolumesGetTest-1922388409 None] Acquiring lock "cinder-quobyte-23461dd6-d73f-43c2-99e5-4f13a11149ee" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:26 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8ba8ac5d-4e20-474d-abf7-bfab90aa76e7 tempest-VolumesGetTest-1922388409 None] Lock "cinder-quobyte-23461dd6-d73f-43c2-99e5-4f13a11149ee" acquired by "delete_volume" :: waited 0.030s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:26 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[324d0ec7-585e-484b-bbf3-510ebfa68c5a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8ba8ac5d-4e20-474d-abf7-bfab90aa76e7 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23461dd6-d73f-43c2-99e5-4f13a11149ee {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:26 devstack sudo[99585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23461dd6-d73f-43c2-99e5-4f13a11149ee
Jul 03 13:12:26 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:26 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a714aa76-0c89-497c-aa2e-abf66bf181b5 tempest-SnapshotsActionsTest-661415319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.3d03526f-5271-4be7-a353-62be09e15472" returned: 0 in 1.250s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a714aa76-0c89-497c-aa2e-abf66bf181b5 tempest-SnapshotsActionsTest-661415319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.3d03526f-5271-4be7-a353-62be09e15472 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:26 devstack sudo[99591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.3d03526f-5271-4be7-a353-62be09e15472
Jul 03 13:12:26 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:27 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8ba8ac5d-4e20-474d-abf7-bfab90aa76e7 tempest-VolumesGetTest-1922388409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23461dd6-d73f-43c2-99e5-4f13a11149ee" returned: 0 in 1.005s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8ba8ac5d-4e20-474d-abf7-bfab90aa76e7 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23461dd6-d73f-43c2-99e5-4f13a11149ee {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:27 devstack sudo[99596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23461dd6-d73f-43c2-99e5-4f13a11149ee
Jul 03 13:12:27 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:27 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a714aa76-0c89-497c-aa2e-abf66bf181b5 tempest-SnapshotsActionsTest-661415319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.3d03526f-5271-4be7-a353-62be09e15472" returned: 0 in 0.983s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:27 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a714aa76-0c89-497c-aa2e-abf66bf181b5 tempest-SnapshotsActionsTest-661415319 None] Lock "cinder-quobyte-3d03526f-5271-4be7-a353-62be09e15472" released by "_delete_snapshot" :: held 4.544s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:27 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a714aa76-0c89-497c-aa2e-abf66bf181b5 tempest-SnapshotsActionsTest-661415319 None] Lock "cinder-quobyte-e7184d0a-0b90-4316-880f-f2c5125f768d" released by "delete_snapshot" :: held 4.582s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:27 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-a714aa76-0c89-497c-aa2e-abf66bf181b5 tempest-SnapshotsActionsTest-661415319 None] Created reservations ['66239061-b2ba-4978-94b1-3f5e7b001beb', 'ba540f2f-2cb6-400d-9d16-628601070646', 'd442c5d1-e6b1-47cc-a623-ca60d80b99d9', 'df300377-929e-4e51-beb8-225c5219febe'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:12:27 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-a714aa76-0c89-497c-aa2e-abf66bf181b5 tempest-SnapshotsActionsTest-661415319 None] Delete snapshot completed successfully.
Jul 03 13:12:27 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a714aa76-0c89-497c-aa2e-abf66bf181b5 tempest-SnapshotsActionsTest-661415319 None] Lock "cinder-3d03526f-5271-4be7-a353-62be09e15472-delete_snapshot" released by "delete_snapshot" :: held 4.823s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:28 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8ba8ac5d-4e20-474d-abf7-bfab90aa76e7 tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-23461dd6-d73f-43c2-99e5-4f13a11149ee" returned: 0 in 0.761s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:28 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8ba8ac5d-4e20-474d-abf7-bfab90aa76e7 tempest-VolumesGetTest-1922388409 None] Lock "cinder-quobyte-23461dd6-d73f-43c2-99e5-4f13a11149ee" released by "delete_volume" :: held 1.828s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:28 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-8ba8ac5d-4e20-474d-abf7-bfab90aa76e7 tempest-VolumesGetTest-1922388409 None] Created reservations ['9a0196a1-7d0e-4cda-9233-3200b8cb0693', '2685a59f-3d7a-4f0f-9bc5-7ac533421983', 'c2540892-9cf4-4ed0-a45a-93c3d1e5f633', '51e8a9f0-dc82-49ad-82d7-5edba8629ed7'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:12:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8ba8ac5d-4e20-474d-abf7-bfab90aa76e7 tempest-VolumesGetTest-1922388409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:12:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8ba8ac5d-4e20-474d-abf7-bfab90aa76e7 tempest-VolumesGetTest-1922388409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:12:28 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8ba8ac5d-4e20-474d-abf7-bfab90aa76e7 tempest-VolumesGetTest-1922388409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:12:28 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8ba8ac5d-4e20-474d-abf7-bfab90aa76e7 tempest-VolumesGetTest-1922388409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:12:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8ba8ac5d-4e20-474d-abf7-bfab90aa76e7 tempest-VolumesGetTest-1922388409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:12:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8ba8ac5d-4e20-474d-abf7-bfab90aa76e7 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:28 devstack sudo[99600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:12:28 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:28 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-55343401-83c4-4984-b456-b80981ba64d6 tempest-VolumesGetTest-1922388409 None] Acquiring lock "cinder-b3d355ad-c940-4b17-ab80-843d3c522d11-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:28 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-55343401-83c4-4984-b456-b80981ba64d6 tempest-VolumesGetTest-1922388409 None] Lock "cinder-b3d355ad-c940-4b17-ab80-843d3c522d11-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:28 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-55343401-83c4-4984-b456-b80981ba64d6 tempest-VolumesGetTest-1922388409 None] Acquiring lock "cinder-quobyte-b3d355ad-c940-4b17-ab80-843d3c522d11" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:28 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-55343401-83c4-4984-b456-b80981ba64d6 tempest-VolumesGetTest-1922388409 None] Lock "cinder-quobyte-b3d355ad-c940-4b17-ab80-843d3c522d11" acquired by "delete_volume" :: waited 0.026s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:28 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cb113e-9842-411e-be48-993d7982d0a2]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-55343401-83c4-4984-b456-b80981ba64d6 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:28 devstack sudo[99602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11
Jul 03 13:12:28 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-99616300-0785-4d8c-b0b7-b0275494a595 tempest-SnapshotsActionsTest-414207452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:12:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-99616300-0785-4d8c-b0b7-b0275494a595 tempest-SnapshotsActionsTest-414207452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:12:28 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-99616300-0785-4d8c-b0b7-b0275494a595 tempest-SnapshotsActionsTest-414207452 None] Creating offline snapshot d20f0f0a-aec4-4613-8dc1-157cd0098b1b of volume e7184d0a-0b90-4316-880f-f2c5125f768d {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:12:29 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b164ea-2643-4500-8b29-7ac4b470ad35]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-99616300-0785-4d8c-b0b7-b0275494a595 tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:29 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8ba8ac5d-4e20-474d-abf7-bfab90aa76e7 tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.851s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:29 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-8ba8ac5d-4e20-474d-abf7-bfab90aa76e7 tempest-VolumesGetTest-1922388409 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:12:29 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-8ba8ac5d-4e20-474d-abf7-bfab90aa76e7 tempest-VolumesGetTest-1922388409 None] Deleted volume successfully.
Jul 03 13:12:29 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8ba8ac5d-4e20-474d-abf7-bfab90aa76e7 tempest-VolumesGetTest-1922388409 None] Lock "cinder-23461dd6-d73f-43c2-99e5-4f13a11149ee-delete_volume" released by "delete_volume" :: held 2.962s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:29 devstack sudo[99605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936
Jul 03 13:12:29 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:29 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-55343401-83c4-4984-b456-b80981ba64d6 tempest-VolumesGetTest-1922388409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11" returned: 0 in 0.987s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-55343401-83c4-4984-b456-b80981ba64d6 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:29 devstack sudo[99609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11
Jul 03 13:12:29 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:29 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-99616300-0785-4d8c-b0b7-b0275494a595 tempest-SnapshotsActionsTest-414207452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936" returned: 0 in 0.921s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:29 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-99616300-0785-4d8c-b0b7-b0275494a595 tempest-SnapshotsActionsTest-414207452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7184d0a-0b90-4316-880f-f2c5125f768d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:12:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-99616300-0785-4d8c-b0b7-b0275494a595 tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.d20f0f0a-aec4-4613-8dc1-157cd0098b1b 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:30 devstack sudo[99614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.d20f0f0a-aec4-4613-8dc1-157cd0098b1b 1G
Jul 03 13:12:30 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:30 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-55343401-83c4-4984-b456-b80981ba64d6 tempest-VolumesGetTest-1922388409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11" returned: 1 in 0.915s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-55343401-83c4-4984-b456-b80981ba64d6 tempest-VolumesGetTest-1922388409 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:12:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-55343401-83c4-4984-b456-b80981ba64d6 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:30 devstack sudo[99622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11
Jul 03 13:12:30 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:31 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-99616300-0785-4d8c-b0b7-b0275494a595 tempest-SnapshotsActionsTest-414207452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.d20f0f0a-aec4-4613-8dc1-157cd0098b1b 1G" returned: 0 in 1.036s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-99616300-0785-4d8c-b0b7-b0275494a595 tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.d20f0f0a-aec4-4613-8dc1-157cd0098b1b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:31 devstack sudo[99625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.d20f0f0a-aec4-4613-8dc1-157cd0098b1b
Jul 03 13:12:31 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:31 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-55343401-83c4-4984-b456-b80981ba64d6 tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b3d355ad-c940-4b17-ab80-843d3c522d11" returned: 0 in 0.800s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:31 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-55343401-83c4-4984-b456-b80981ba64d6 tempest-VolumesGetTest-1922388409 None] Lock "cinder-quobyte-b3d355ad-c940-4b17-ab80-843d3c522d11" released by "delete_volume" :: held 2.795s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:31 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-55343401-83c4-4984-b456-b80981ba64d6 tempest-VolumesGetTest-1922388409 None] Created reservations ['f8935d5d-7f78-4a04-bdad-98f5f4f406c6', '1b3e3069-3a04-41ec-abad-ca7c4261b218', 'ec0b86c1-20df-4aea-9afc-6ddb1c790e7a', 'b7072d16-62ce-4749-b13b-3b7b1bc7518b'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:12:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-55343401-83c4-4984-b456-b80981ba64d6 tempest-VolumesGetTest-1922388409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:12:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-55343401-83c4-4984-b456-b80981ba64d6 tempest-VolumesGetTest-1922388409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:12:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-55343401-83c4-4984-b456-b80981ba64d6 tempest-VolumesGetTest-1922388409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:12:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-55343401-83c4-4984-b456-b80981ba64d6 tempest-VolumesGetTest-1922388409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:12:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-55343401-83c4-4984-b456-b80981ba64d6 tempest-VolumesGetTest-1922388409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:12:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-55343401-83c4-4984-b456-b80981ba64d6 tempest-VolumesGetTest-1922388409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:31 devstack sudo[99628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:12:31 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:31 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-99616300-0785-4d8c-b0b7-b0275494a595 tempest-SnapshotsActionsTest-414207452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.d20f0f0a-aec4-4613-8dc1-157cd0098b1b" returned: 0 in 0.894s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:31 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-99616300-0785-4d8c-b0b7-b0275494a595 tempest-SnapshotsActionsTest-414207452 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.d20f0f0a-aec4-4613-8dc1-157cd0098b1b is being set with open permissions: ugo+rw
Jul 03 13:12:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-99616300-0785-4d8c-b0b7-b0275494a595 tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.d20f0f0a-aec4-4613-8dc1-157cd0098b1b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:31 devstack sudo[99633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.d20f0f0a-aec4-4613-8dc1-157cd0098b1b
Jul 03 13:12:31 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:32 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-55343401-83c4-4984-b456-b80981ba64d6 tempest-VolumesGetTest-1922388409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.854s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:32 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-55343401-83c4-4984-b456-b80981ba64d6 tempest-VolumesGetTest-1922388409 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:12:32 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-55343401-83c4-4984-b456-b80981ba64d6 tempest-VolumesGetTest-1922388409 None] Deleted volume successfully.
Jul 03 13:12:32 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-55343401-83c4-4984-b456-b80981ba64d6 tempest-VolumesGetTest-1922388409 None] Lock "cinder-b3d355ad-c940-4b17-ab80-843d3c522d11-delete_volume" released by "delete_volume" :: held 3.952s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:32 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-99616300-0785-4d8c-b0b7-b0275494a595 tempest-SnapshotsActionsTest-414207452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.d20f0f0a-aec4-4613-8dc1-157cd0098b1b" returned: 0 in 0.986s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-99616300-0785-4d8c-b0b7-b0275494a595 tempest-SnapshotsActionsTest-414207452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.980s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:12:33 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-99616300-0785-4d8c-b0b7-b0275494a595 tempest-SnapshotsActionsTest-414207452 None] Create snapshot completed successfully
Jul 03 13:12:33 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9efa9baf-5d82-482b-845b-19156d2ea59e tempest-SnapshotsActionsTest-661415319 None] Acquiring lock "cinder-d20f0f0a-aec4-4613-8dc1-157cd0098b1b-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:33 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9efa9baf-5d82-482b-845b-19156d2ea59e tempest-SnapshotsActionsTest-661415319 None] Lock "cinder-d20f0f0a-aec4-4613-8dc1-157cd0098b1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:33 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9efa9baf-5d82-482b-845b-19156d2ea59e tempest-SnapshotsActionsTest-661415319 None] Acquiring lock "cinder-quobyte-e7184d0a-0b90-4316-880f-f2c5125f768d" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:33 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9efa9baf-5d82-482b-845b-19156d2ea59e tempest-SnapshotsActionsTest-661415319 None] Lock "cinder-quobyte-e7184d0a-0b90-4316-880f-f2c5125f768d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:33 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9efa9baf-5d82-482b-845b-19156d2ea59e tempest-SnapshotsActionsTest-661415319 None] Acquiring lock "cinder-quobyte-d20f0f0a-aec4-4613-8dc1-157cd0098b1b" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:33 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9efa9baf-5d82-482b-845b-19156d2ea59e tempest-SnapshotsActionsTest-661415319 None] Lock "cinder-quobyte-d20f0f0a-aec4-4613-8dc1-157cd0098b1b" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:33 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-9efa9baf-5d82-482b-845b-19156d2ea59e tempest-SnapshotsActionsTest-661415319 None] Deleting offline snapshot d20f0f0a-aec4-4613-8dc1-157cd0098b1b of volume e7184d0a-0b90-4316-880f-f2c5125f768d {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:12:33 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-9efa9baf-5d82-482b-845b-19156d2ea59e tempest-SnapshotsActionsTest-661415319 None] snapshot_file for this snap is: volume-e7184d0a-0b90-4316-880f-f2c5125f768d.d20f0f0a-aec4-4613-8dc1-157cd0098b1b {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:12:33 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e63ec72-edd3-4033-bb07-1c52561f423c]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9efa9baf-5d82-482b-845b-19156d2ea59e tempest-SnapshotsActionsTest-661415319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.d20f0f0a-aec4-4613-8dc1-157cd0098b1b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:33 devstack sudo[99638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.d20f0f0a-aec4-4613-8dc1-157cd0098b1b
Jul 03 13:12:33 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:34 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9efa9baf-5d82-482b-845b-19156d2ea59e tempest-SnapshotsActionsTest-661415319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.d20f0f0a-aec4-4613-8dc1-157cd0098b1b" returned: 0 in 0.962s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-9efa9baf-5d82-482b-845b-19156d2ea59e tempest-SnapshotsActionsTest-661415319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7184d0a-0b90-4316-880f-f2c5125f768d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:12:34 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0e8192-7957-4c70-8adb-d0c98ab3cbee]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9efa9baf-5d82-482b-845b-19156d2ea59e tempest-SnapshotsActionsTest-661415319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:34 devstack sudo[99643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936
Jul 03 13:12:34 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:35 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9efa9baf-5d82-482b-845b-19156d2ea59e tempest-SnapshotsActionsTest-661415319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936" returned: 0 in 0.887s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-9efa9baf-5d82-482b-845b-19156d2ea59e tempest-SnapshotsActionsTest-661415319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7184d0a-0b90-4316-880f-f2c5125f768d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:12:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9efa9baf-5d82-482b-845b-19156d2ea59e tempest-SnapshotsActionsTest-661415319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.d20f0f0a-aec4-4613-8dc1-157cd0098b1b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:35 devstack sudo[99648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.d20f0f0a-aec4-4613-8dc1-157cd0098b1b
Jul 03 13:12:35 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:36 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9efa9baf-5d82-482b-845b-19156d2ea59e tempest-SnapshotsActionsTest-661415319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.d20f0f0a-aec4-4613-8dc1-157cd0098b1b" returned: 0 in 1.063s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9efa9baf-5d82-482b-845b-19156d2ea59e tempest-SnapshotsActionsTest-661415319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.d20f0f0a-aec4-4613-8dc1-157cd0098b1b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:36 devstack sudo[99654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.d20f0f0a-aec4-4613-8dc1-157cd0098b1b
Jul 03 13:12:36 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:37 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9efa9baf-5d82-482b-845b-19156d2ea59e tempest-SnapshotsActionsTest-661415319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.d20f0f0a-aec4-4613-8dc1-157cd0098b1b" returned: 0 in 0.695s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:37 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9efa9baf-5d82-482b-845b-19156d2ea59e tempest-SnapshotsActionsTest-661415319 None] Lock "cinder-quobyte-d20f0f0a-aec4-4613-8dc1-157cd0098b1b" released by "_delete_snapshot" :: held 3.741s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:37 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9efa9baf-5d82-482b-845b-19156d2ea59e tempest-SnapshotsActionsTest-661415319 None] Lock "cinder-quobyte-e7184d0a-0b90-4316-880f-f2c5125f768d" released by "delete_snapshot" :: held 3.785s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:37 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-9efa9baf-5d82-482b-845b-19156d2ea59e tempest-SnapshotsActionsTest-661415319 None] Created reservations ['8b85d752-4416-499b-85de-e4bbf06d3ef4', '3a717629-de90-4c70-ba90-2161509e9bba', '28d900de-8952-408b-9e14-bbfbea3d2f36', '7bde02d9-3b7d-4ad2-9a5b-07ba8b74a721'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:12:37 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-9efa9baf-5d82-482b-845b-19156d2ea59e tempest-SnapshotsActionsTest-661415319 None] Delete snapshot completed successfully.
Jul 03 13:12:37 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9efa9baf-5d82-482b-845b-19156d2ea59e tempest-SnapshotsActionsTest-661415319 None] Lock "cinder-d20f0f0a-aec4-4613-8dc1-157cd0098b1b-delete_snapshot" released by "delete_snapshot" :: held 3.956s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-77b0810d-f947-40db-b312-45f6f54df6b4 tempest-SnapshotsActionsTest-414207452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:12:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-77b0810d-f947-40db-b312-45f6f54df6b4 tempest-SnapshotsActionsTest-414207452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:12:38 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-77b0810d-f947-40db-b312-45f6f54df6b4 tempest-SnapshotsActionsTest-414207452 None] Creating offline snapshot 2e347acf-e6fc-4b0b-bfda-906a5263ccbd of volume e7184d0a-0b90-4316-880f-f2c5125f768d {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:12:38 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a526149-832a-4729-aa43-655bc66acced]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-77b0810d-f947-40db-b312-45f6f54df6b4 tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:38 devstack sudo[99657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936
Jul 03 13:12:38 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:39 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-77b0810d-f947-40db-b312-45f6f54df6b4 tempest-SnapshotsActionsTest-414207452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936" returned: 0 in 0.904s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-77b0810d-f947-40db-b312-45f6f54df6b4 tempest-SnapshotsActionsTest-414207452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7184d0a-0b90-4316-880f-f2c5125f768d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:12:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-77b0810d-f947-40db-b312-45f6f54df6b4 tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.2e347acf-e6fc-4b0b-bfda-906a5263ccbd 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:39 devstack sudo[99662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.2e347acf-e6fc-4b0b-bfda-906a5263ccbd 1G
Jul 03 13:12:39 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:40 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-77b0810d-f947-40db-b312-45f6f54df6b4 tempest-SnapshotsActionsTest-414207452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.2e347acf-e6fc-4b0b-bfda-906a5263ccbd 1G" returned: 0 in 1.048s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-77b0810d-f947-40db-b312-45f6f54df6b4 tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.2e347acf-e6fc-4b0b-bfda-906a5263ccbd {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:40 devstack sudo[99668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.2e347acf-e6fc-4b0b-bfda-906a5263ccbd
Jul 03 13:12:40 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:41 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-77b0810d-f947-40db-b312-45f6f54df6b4 tempest-SnapshotsActionsTest-414207452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.2e347acf-e6fc-4b0b-bfda-906a5263ccbd" returned: 0 in 1.033s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:41 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-77b0810d-f947-40db-b312-45f6f54df6b4 tempest-SnapshotsActionsTest-414207452 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.2e347acf-e6fc-4b0b-bfda-906a5263ccbd is being set with open permissions: ugo+rw
Jul 03 13:12:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-77b0810d-f947-40db-b312-45f6f54df6b4 tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.2e347acf-e6fc-4b0b-bfda-906a5263ccbd {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:41 devstack sudo[99674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.2e347acf-e6fc-4b0b-bfda-906a5263ccbd
Jul 03 13:12:41 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:41 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-77b0810d-f947-40db-b312-45f6f54df6b4 tempest-SnapshotsActionsTest-414207452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.2e347acf-e6fc-4b0b-bfda-906a5263ccbd" returned: 0 in 0.819s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-77b0810d-f947-40db-b312-45f6f54df6b4 tempest-SnapshotsActionsTest-414207452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.937s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:12:41 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-77b0810d-f947-40db-b312-45f6f54df6b4 tempest-SnapshotsActionsTest-414207452 None] Create snapshot completed successfully
Jul 03 13:12:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-35d54f9b-b830-4df8-8f81-6ceeba74c1ea tempest-SnapshotsActionsTest-661415319 None] Acquiring lock "cinder-2e347acf-e6fc-4b0b-bfda-906a5263ccbd-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-35d54f9b-b830-4df8-8f81-6ceeba74c1ea tempest-SnapshotsActionsTest-661415319 None] Lock "cinder-2e347acf-e6fc-4b0b-bfda-906a5263ccbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-35d54f9b-b830-4df8-8f81-6ceeba74c1ea tempest-SnapshotsActionsTest-661415319 None] Acquiring lock "cinder-quobyte-e7184d0a-0b90-4316-880f-f2c5125f768d" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-35d54f9b-b830-4df8-8f81-6ceeba74c1ea tempest-SnapshotsActionsTest-661415319 None] Lock "cinder-quobyte-e7184d0a-0b90-4316-880f-f2c5125f768d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-35d54f9b-b830-4df8-8f81-6ceeba74c1ea tempest-SnapshotsActionsTest-661415319 None] Acquiring lock "cinder-quobyte-2e347acf-e6fc-4b0b-bfda-906a5263ccbd" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-35d54f9b-b830-4df8-8f81-6ceeba74c1ea tempest-SnapshotsActionsTest-661415319 None] Lock "cinder-quobyte-2e347acf-e6fc-4b0b-bfda-906a5263ccbd" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:42 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-35d54f9b-b830-4df8-8f81-6ceeba74c1ea tempest-SnapshotsActionsTest-661415319 None] Deleting offline snapshot 2e347acf-e6fc-4b0b-bfda-906a5263ccbd of volume e7184d0a-0b90-4316-880f-f2c5125f768d {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:12:42 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-35d54f9b-b830-4df8-8f81-6ceeba74c1ea tempest-SnapshotsActionsTest-661415319 None] snapshot_file for this snap is: volume-e7184d0a-0b90-4316-880f-f2c5125f768d.2e347acf-e6fc-4b0b-bfda-906a5263ccbd {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:12:42 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3f1329-e082-4746-bd64-6948561b30ac]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-35d54f9b-b830-4df8-8f81-6ceeba74c1ea tempest-SnapshotsActionsTest-661415319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.2e347acf-e6fc-4b0b-bfda-906a5263ccbd {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:42 devstack sudo[99677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.2e347acf-e6fc-4b0b-bfda-906a5263ccbd
Jul 03 13:12:42 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:43 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-35d54f9b-b830-4df8-8f81-6ceeba74c1ea tempest-SnapshotsActionsTest-661415319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.2e347acf-e6fc-4b0b-bfda-906a5263ccbd" returned: 0 in 0.876s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:43 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-35d54f9b-b830-4df8-8f81-6ceeba74c1ea tempest-SnapshotsActionsTest-661415319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7184d0a-0b90-4316-880f-f2c5125f768d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:12:43 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[08026d27-9317-4c7c-bde0-1af1782594ae]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-35d54f9b-b830-4df8-8f81-6ceeba74c1ea tempest-SnapshotsActionsTest-661415319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:43 devstack sudo[99683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936
Jul 03 13:12:43 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:44 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-35d54f9b-b830-4df8-8f81-6ceeba74c1ea tempest-SnapshotsActionsTest-661415319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936" returned: 0 in 0.974s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-35d54f9b-b830-4df8-8f81-6ceeba74c1ea tempest-SnapshotsActionsTest-661415319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7184d0a-0b90-4316-880f-f2c5125f768d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:12:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-35d54f9b-b830-4df8-8f81-6ceeba74c1ea tempest-SnapshotsActionsTest-661415319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.2e347acf-e6fc-4b0b-bfda-906a5263ccbd {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:44 devstack sudo[99688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.2e347acf-e6fc-4b0b-bfda-906a5263ccbd
Jul 03 13:12:44 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:45 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-35d54f9b-b830-4df8-8f81-6ceeba74c1ea tempest-SnapshotsActionsTest-661415319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.2e347acf-e6fc-4b0b-bfda-906a5263ccbd" returned: 0 in 0.985s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-35d54f9b-b830-4df8-8f81-6ceeba74c1ea tempest-SnapshotsActionsTest-661415319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.2e347acf-e6fc-4b0b-bfda-906a5263ccbd {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:45 devstack sudo[99694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.2e347acf-e6fc-4b0b-bfda-906a5263ccbd
Jul 03 13:12:45 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:46 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-35d54f9b-b830-4df8-8f81-6ceeba74c1ea tempest-SnapshotsActionsTest-661415319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.2e347acf-e6fc-4b0b-bfda-906a5263ccbd" returned: 0 in 0.961s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:46 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-35d54f9b-b830-4df8-8f81-6ceeba74c1ea tempest-SnapshotsActionsTest-661415319 None] Lock "cinder-quobyte-2e347acf-e6fc-4b0b-bfda-906a5263ccbd" released by "_delete_snapshot" :: held 3.940s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:46 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-35d54f9b-b830-4df8-8f81-6ceeba74c1ea tempest-SnapshotsActionsTest-661415319 None] Lock "cinder-quobyte-e7184d0a-0b90-4316-880f-f2c5125f768d" released by "delete_snapshot" :: held 3.976s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:46 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-35d54f9b-b830-4df8-8f81-6ceeba74c1ea tempest-SnapshotsActionsTest-661415319 None] Created reservations ['2a19f41d-a39f-42d0-b2b4-4c95fefda7f7', '0d8f2e41-348f-4ec1-b3eb-8d809b7bcc8a', '5e6114fe-7c32-45c9-88e8-ab97063014cb', '6bb0ffd7-a037-40c3-8cf6-8ca3da7f05bb'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:12:46 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-35d54f9b-b830-4df8-8f81-6ceeba74c1ea tempest-SnapshotsActionsTest-661415319 None] Delete snapshot completed successfully.
Jul 03 13:12:46 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-35d54f9b-b830-4df8-8f81-6ceeba74c1ea tempest-SnapshotsActionsTest-661415319 None] Lock "cinder-2e347acf-e6fc-4b0b-bfda-906a5263ccbd-delete_snapshot" released by "delete_snapshot" :: held 4.172s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ad480fb7-1872-406b-8b4d-beab865259d9 tempest-SnapshotsActionsTest-414207452 None] Acquiring lock "cinder-7cc6e7d1-2683-4f95-950a-06eea69bd936-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ad480fb7-1872-406b-8b4d-beab865259d9 tempest-SnapshotsActionsTest-414207452 None] Lock "cinder-7cc6e7d1-2683-4f95-950a-06eea69bd936-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ad480fb7-1872-406b-8b4d-beab865259d9 tempest-SnapshotsActionsTest-414207452 None] Acquiring lock "cinder-quobyte-e7184d0a-0b90-4316-880f-f2c5125f768d" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ad480fb7-1872-406b-8b4d-beab865259d9 tempest-SnapshotsActionsTest-414207452 None] Lock "cinder-quobyte-e7184d0a-0b90-4316-880f-f2c5125f768d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ad480fb7-1872-406b-8b4d-beab865259d9 tempest-SnapshotsActionsTest-414207452 None] Acquiring lock "cinder-quobyte-7cc6e7d1-2683-4f95-950a-06eea69bd936" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ad480fb7-1872-406b-8b4d-beab865259d9 tempest-SnapshotsActionsTest-414207452 None] Lock "cinder-quobyte-7cc6e7d1-2683-4f95-950a-06eea69bd936" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:47 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-ad480fb7-1872-406b-8b4d-beab865259d9 tempest-SnapshotsActionsTest-414207452 None] Deleting offline snapshot 7cc6e7d1-2683-4f95-950a-06eea69bd936 of volume e7184d0a-0b90-4316-880f-f2c5125f768d {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:12:47 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-ad480fb7-1872-406b-8b4d-beab865259d9 tempest-SnapshotsActionsTest-414207452 None] snapshot_file for this snap is: volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:12:47 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a34930-6e0e-4525-85cc-927ea3cee04b]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ad480fb7-1872-406b-8b4d-beab865259d9 tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:47 devstack sudo[99697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936
Jul 03 13:12:47 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:48 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ad480fb7-1872-406b-8b4d-beab865259d9 tempest-SnapshotsActionsTest-414207452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936" returned: 0 in 0.955s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:48 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-ad480fb7-1872-406b-8b4d-beab865259d9 tempest-SnapshotsActionsTest-414207452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7184d0a-0b90-4316-880f-f2c5125f768d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:12:48 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e28b8cc-0736-458e-9a1c-f90affb8c5ad]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ad480fb7-1872-406b-8b4d-beab865259d9 tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:48 devstack sudo[99704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d
Jul 03 13:12:48 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:49 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ad480fb7-1872-406b-8b4d-beab865259d9 tempest-SnapshotsActionsTest-414207452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d" returned: 0 in 0.863s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ad480fb7-1872-406b-8b4d-beab865259d9 tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:49 devstack sudo[99709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936
Jul 03 13:12:49 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:50 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ad480fb7-1872-406b-8b4d-beab865259d9 tempest-SnapshotsActionsTest-414207452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936" returned: 0 in 0.836s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ad480fb7-1872-406b-8b4d-beab865259d9 tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:50 devstack sudo[99714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936
Jul 03 13:12:50 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:50 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ad480fb7-1872-406b-8b4d-beab865259d9 tempest-SnapshotsActionsTest-414207452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d.7cc6e7d1-2683-4f95-950a-06eea69bd936" returned: 0 in 0.725s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:50 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=111,cinder:UPDATE=125,cinder:INSERT=37,cinder:DELETE=9 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:12:50 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=92,cinder:DELETE=12,cinder:INSERT=38,cinder:UPDATE=115 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:12:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ad480fb7-1872-406b-8b4d-beab865259d9 tempest-SnapshotsActionsTest-414207452 None] Lock "cinder-quobyte-7cc6e7d1-2683-4f95-950a-06eea69bd936" released by "_delete_snapshot" :: held 3.549s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ad480fb7-1872-406b-8b4d-beab865259d9 tempest-SnapshotsActionsTest-414207452 None] Lock "cinder-quobyte-e7184d0a-0b90-4316-880f-f2c5125f768d" released by "delete_snapshot" :: held 3.578s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:50 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-ad480fb7-1872-406b-8b4d-beab865259d9 tempest-SnapshotsActionsTest-414207452 None] Created reservations ['837786dd-0dcc-4afd-8e5f-5d0521bebcd3', 'fc94f476-3d0f-4b12-837f-6823f4c18402', '68dc3e76-1ace-466e-abec-28706be7d92f', 'cf88d44d-6b60-4142-ab6c-3adb5766d9b6'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:12:50 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:12:50 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Flow 'volume_create_manager' (448a06fe-bc84-481a-8c9d-6a4b4275b7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:12:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f28e06c-7cc3-4a7f-84dd-e3b000ca35e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:12:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f28e06c-7cc3-4a7f-84dd-e3b000ca35e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-793105217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69115016-e8f6-4746-9fbc-48c8d8a252f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a70c352f349c47099dee0e3fa338c480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:12:51Z,use_quota=True,user_id='647ba13f613941b6acbeac38f4091e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:12:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399c3c9d-1c80-471f-9855-3841b5994805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:12:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399c3c9d-1c80-471f-9855-3841b5994805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:12:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60923dc4-b925-42d3-9bf2-63f5d8c44243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:12:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60923dc4-b925-42d3-9bf2-63f5d8c44243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69115016-e8f6-4746-9fbc-48c8d8a252f6', 'volume_name': 'volume-69115016-e8f6-4746-9fbc-48c8d8a252f6', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:12:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (212b089d-f719-4ddf-8a08-79c26ec34483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:12:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (212b089d-f719-4ddf-8a08-79c26ec34483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:12:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17725e6f-970d-4698-bc25-19df305169d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:12:51 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Volume 69115016-e8f6-4746-9fbc-48c8d8a252f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69115016-e8f6-4746-9fbc-48c8d8a252f6', 'volume_size': 1}
Jul 03 13:12:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:12:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:12:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-793105217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69115016-e8f6-4746-9fbc-48c8d8a252f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a70c352f349c47099dee0e3fa338c480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:12:51Z,use_quota=True,user_id='647ba13f613941b6acbeac38f4091e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:12:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Creating volume 69115016-e8f6-4746-9fbc-48c8d8a252f6 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:12:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:12:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:12:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:12:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:12:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:12:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:12:51 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:12:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-69115016-e8f6-4746-9fbc-48c8d8a252f6 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:51 devstack sudo[99717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-69115016-e8f6-4746-9fbc-48c8d8a252f6 1073741824
Jul 03 13:12:51 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:51 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-ad480fb7-1872-406b-8b4d-beab865259d9 tempest-SnapshotsActionsTest-414207452 None] Delete snapshot completed successfully.
Jul 03 13:12:51 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ad480fb7-1872-406b-8b4d-beab865259d9 tempest-SnapshotsActionsTest-414207452 None] Lock "cinder-7cc6e7d1-2683-4f95-950a-06eea69bd936-delete_snapshot" released by "delete_snapshot" :: held 3.865s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:51 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1ec7250e-3c9a-4f9c-8092-441f1d3663aa tempest-SnapshotsActionsTest-414207452 None] Acquiring lock "cinder-e7184d0a-0b90-4316-880f-f2c5125f768d-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:51 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1ec7250e-3c9a-4f9c-8092-441f1d3663aa tempest-SnapshotsActionsTest-414207452 None] Lock "cinder-e7184d0a-0b90-4316-880f-f2c5125f768d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:51 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1ec7250e-3c9a-4f9c-8092-441f1d3663aa tempest-SnapshotsActionsTest-414207452 None] Acquiring lock "cinder-quobyte-e7184d0a-0b90-4316-880f-f2c5125f768d" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:51 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1ec7250e-3c9a-4f9c-8092-441f1d3663aa tempest-SnapshotsActionsTest-414207452 None] Lock "cinder-quobyte-e7184d0a-0b90-4316-880f-f2c5125f768d" acquired by "delete_volume" :: waited 0.026s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:51 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[44845b80-d50d-4199-9230-bf2d98a09bf6]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1ec7250e-3c9a-4f9c-8092-441f1d3663aa tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:51 devstack sudo[99722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d
Jul 03 13:12:51 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:52 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-69115016-e8f6-4746-9fbc-48c8d8a252f6 1073741824" returned: 0 in 1.019s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-69115016-e8f6-4746-9fbc-48c8d8a252f6 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:52 devstack sudo[99725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-69115016-e8f6-4746-9fbc-48c8d8a252f6
Jul 03 13:12:52 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:52 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1ec7250e-3c9a-4f9c-8092-441f1d3663aa tempest-SnapshotsActionsTest-414207452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d" returned: 0 in 1.026s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1ec7250e-3c9a-4f9c-8092-441f1d3663aa tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:52 devstack sudo[99731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d
Jul 03 13:12:52 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:52 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-69115016-e8f6-4746-9fbc-48c8d8a252f6" returned: 0 in 0.801s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] <== create_volume: return (1860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:12:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:12:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17725e6f-970d-4698-bc25-19df305169d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69115016-e8f6-4746-9fbc-48c8d8a252f6', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:12:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d381901-1818-4849-abce-6fbbeafa95ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:12:53 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Volume volume-69115016-e8f6-4746-9fbc-48c8d8a252f6 (69115016-e8f6-4746-9fbc-48c8d8a252f6): created successfully
Jul 03 13:12:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d381901-1818-4849-abce-6fbbeafa95ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:12:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Flow 'volume_create_manager' (448a06fe-bc84-481a-8c9d-6a4b4275b7da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:12:53 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-67ea7105-dee4-42b0-8091-1d0c0188d2f6 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Created volume successfully.
Jul 03 13:12:53 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1ec7250e-3c9a-4f9c-8092-441f1d3663aa tempest-SnapshotsActionsTest-414207452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e7184d0a-0b90-4316-880f-f2c5125f768d" returned: 0 in 0.751s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:53 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1ec7250e-3c9a-4f9c-8092-441f1d3663aa tempest-SnapshotsActionsTest-414207452 None] Lock "cinder-quobyte-e7184d0a-0b90-4316-880f-f2c5125f768d" released by "delete_volume" :: held 1.844s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:53 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-1ec7250e-3c9a-4f9c-8092-441f1d3663aa tempest-SnapshotsActionsTest-414207452 None] Created reservations ['52f8cf32-1a27-45f3-a5c6-f3847fc978ec', 'd095ed1d-21ff-4c44-aa3d-2ffe36ffff87', '21a5c30e-8ac4-4478-a627-d034cc7c65cb', 'c962e13b-6cfa-4c11-870b-432c219d8249'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:12:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1ec7250e-3c9a-4f9c-8092-441f1d3663aa tempest-SnapshotsActionsTest-414207452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:12:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1ec7250e-3c9a-4f9c-8092-441f1d3663aa tempest-SnapshotsActionsTest-414207452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:12:53 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1ec7250e-3c9a-4f9c-8092-441f1d3663aa tempest-SnapshotsActionsTest-414207452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:12:53 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1ec7250e-3c9a-4f9c-8092-441f1d3663aa tempest-SnapshotsActionsTest-414207452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:12:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1ec7250e-3c9a-4f9c-8092-441f1d3663aa tempest-SnapshotsActionsTest-414207452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:12:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1ec7250e-3c9a-4f9c-8092-441f1d3663aa tempest-SnapshotsActionsTest-414207452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:53 devstack sudo[99735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:12:53 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:54 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1ec7250e-3c9a-4f9c-8092-441f1d3663aa tempest-SnapshotsActionsTest-414207452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.942s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:54 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-1ec7250e-3c9a-4f9c-8092-441f1d3663aa tempest-SnapshotsActionsTest-414207452 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:12:54 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-1ec7250e-3c9a-4f9c-8092-441f1d3663aa tempest-SnapshotsActionsTest-414207452 None] Deleted volume successfully.
Jul 03 13:12:54 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1ec7250e-3c9a-4f9c-8092-441f1d3663aa tempest-SnapshotsActionsTest-414207452 None] Lock "cinder-e7184d0a-0b90-4316-880f-f2c5125f768d-delete_volume" released by "delete_volume" :: held 3.110s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-bffd27ad-cef6-4610-aaaa-2e3003e36601 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Acquiring lock "cinder-69115016-e8f6-4746-9fbc-48c8d8a252f6-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-bffd27ad-cef6-4610-aaaa-2e3003e36601 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Lock "cinder-69115016-e8f6-4746-9fbc-48c8d8a252f6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-bffd27ad-cef6-4610-aaaa-2e3003e36601 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Acquiring lock "cinder-quobyte-69115016-e8f6-4746-9fbc-48c8d8a252f6" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:12:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-bffd27ad-cef6-4610-aaaa-2e3003e36601 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Lock "cinder-quobyte-69115016-e8f6-4746-9fbc-48c8d8a252f6" acquired by "delete_volume" :: waited 0.028s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:12:55 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2b5479-1939-4b44-9e1e-9ed9de7c31ac]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:12:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bffd27ad-cef6-4610-aaaa-2e3003e36601 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-69115016-e8f6-4746-9fbc-48c8d8a252f6 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:56 devstack sudo[99739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-69115016-e8f6-4746-9fbc-48c8d8a252f6
Jul 03 13:12:56 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:56 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bffd27ad-cef6-4610-aaaa-2e3003e36601 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-69115016-e8f6-4746-9fbc-48c8d8a252f6" returned: 0 in 0.996s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bffd27ad-cef6-4610-aaaa-2e3003e36601 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-69115016-e8f6-4746-9fbc-48c8d8a252f6 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:57 devstack sudo[99744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-69115016-e8f6-4746-9fbc-48c8d8a252f6
Jul 03 13:12:57 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:57 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bffd27ad-cef6-4610-aaaa-2e3003e36601 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-69115016-e8f6-4746-9fbc-48c8d8a252f6" returned: 0 in 0.767s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-bffd27ad-cef6-4610-aaaa-2e3003e36601 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Lock "cinder-quobyte-69115016-e8f6-4746-9fbc-48c8d8a252f6" released by "delete_volume" :: held 1.824s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:12:57 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-bffd27ad-cef6-4610-aaaa-2e3003e36601 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Created reservations ['ad7cd994-f2fa-495a-80ab-cbe59d9e2a51', '8f6aef3b-9642-4b31-b91e-d2daeae96cfc', 'eaf73724-06e1-4851-98ce-cecd77362f84', 'd55d198d-f902-4964-ad45-87c419bfad64'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:12:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bffd27ad-cef6-4610-aaaa-2e3003e36601 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:12:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bffd27ad-cef6-4610-aaaa-2e3003e36601 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:12:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-bffd27ad-cef6-4610-aaaa-2e3003e36601 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:12:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-bffd27ad-cef6-4610-aaaa-2e3003e36601 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:12:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bffd27ad-cef6-4610-aaaa-2e3003e36601 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:12:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bffd27ad-cef6-4610-aaaa-2e3003e36601 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:12:58 devstack sudo[99748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:12:58 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:12:58 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root
Jul 03 13:12:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bffd27ad-cef6-4610-aaaa-2e3003e36601 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.867s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:12:58 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-bffd27ad-cef6-4610-aaaa-2e3003e36601 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:12:58 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-bffd27ad-cef6-4610-aaaa-2e3003e36601 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Deleted volume successfully.
Jul 03 13:12:58 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-bffd27ad-cef6-4610-aaaa-2e3003e36601 tempest-VolumeQuotasNegativeTestJSON-1524887628 None] Lock "cinder-69115016-e8f6-4746-9fbc-48c8d8a252f6-delete_volume" released by "delete_volume" :: held 2.993s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:13:06 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:13:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Flow 'volume_create_manager' (21b45607-67c8-46ad-ad99-882d3d982833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c7bb784-98e6-4547-b574-8847515564a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c7bb784-98e6-4547-b574-8847515564a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2095384360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b775cec-8f45-42f6-b112-147512f843ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ecb1798c6b94d54b4587718cb3648b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:06Z,use_quota=True,user_id='9f8fd237ea51448ab6b926d396357593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfdff7df-bfd1-4bca-9ec3-8b3759dad73c),volume_type_id=dfdff7df-bfd1-4bca-9ec3-8b3759dad73c)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a0de71-3858-488f-b9ea-700fdc87834b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a0de71-3858-488f-b9ea-700fdc87834b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06db335b-114b-47af-baf8-3d1cbe45ef7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06db335b-114b-47af-baf8-3d1cbe45ef7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b775cec-8f45-42f6-b112-147512f843ca', 'volume_name': 'volume-7b775cec-8f45-42f6-b112-147512f843ca', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c598b6c-0f1a-4c25-830b-be3e8e34de82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c598b6c-0f1a-4c25-830b-be3e8e34de82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90f45964-1472-49b6-9c37-053a553365f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:06 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Volume 7b775cec-8f45-42f6-b112-147512f843ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b775cec-8f45-42f6-b112-147512f843ca', 'volume_size': 1}
Jul 03 13:13:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2095384360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b775cec-8f45-42f6-b112-147512f843ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ecb1798c6b94d54b4587718cb3648b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:06Z,use_quota=True,user_id='9f8fd237ea51448ab6b926d396357593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfdff7df-bfd1-4bca-9ec3-8b3759dad73c),volume_type_id=dfdff7df-bfd1-4bca-9ec3-8b3759dad73c)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:13:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Creating volume 7b775cec-8f45-42f6-b112-147512f843ca {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:13:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:13:06 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:13:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7b775cec-8f45-42f6-b112-147512f843ca 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:06 devstack sudo[99757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7b775cec-8f45-42f6-b112-147512f843ca 1073741824
Jul 03 13:13:06 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:07 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7b775cec-8f45-42f6-b112-147512f843ca 1073741824" returned: 0 in 0.935s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7b775cec-8f45-42f6-b112-147512f843ca {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:07 devstack sudo[99763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7b775cec-8f45-42f6-b112-147512f843ca
Jul 03 13:13:07 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:08 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7b775cec-8f45-42f6-b112-147512f843ca" returned: 0 in 0.770s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:13:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.760s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90f45964-1472-49b6-9c37-053a553365f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b775cec-8f45-42f6-b112-147512f843ca', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3231758e-39e4-42b1-8456-03eaf99c3579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:08 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Volume volume-7b775cec-8f45-42f6-b112-147512f843ca (7b775cec-8f45-42f6-b112-147512f843ca): created successfully
Jul 03 13:13:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3231758e-39e4-42b1-8456-03eaf99c3579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Flow 'volume_create_manager' (21b45607-67c8-46ad-ad99-882d3d982833) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:08 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-ed19afce-7340-46f3-b766-b25cd253aab2 tempest-VolumeTypesAccessTest-425469550 None] Created volume successfully.
Jul 03 13:13:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7c467433-ba5a-4458-ab66-343840f96c2e tempest-VolumeTypesAccessTest-425469550 None] Acquiring lock "cinder-7b775cec-8f45-42f6-b112-147512f843ca-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:13:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7c467433-ba5a-4458-ab66-343840f96c2e tempest-VolumeTypesAccessTest-425469550 None] Lock "cinder-7b775cec-8f45-42f6-b112-147512f843ca-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:13:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7c467433-ba5a-4458-ab66-343840f96c2e tempest-VolumeTypesAccessTest-425469550 None] Acquiring lock "cinder-quobyte-7b775cec-8f45-42f6-b112-147512f843ca" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:13:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7c467433-ba5a-4458-ab66-343840f96c2e tempest-VolumeTypesAccessTest-425469550 None] Lock "cinder-quobyte-7b775cec-8f45-42f6-b112-147512f843ca" acquired by "delete_volume" :: waited 0.028s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:13:08 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[801b47e5-03b5-40a6-b8b5-c7880197dbaa]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:13:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7c467433-ba5a-4458-ab66-343840f96c2e tempest-VolumeTypesAccessTest-425469550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7b775cec-8f45-42f6-b112-147512f843ca {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:08 devstack sudo[99766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7b775cec-8f45-42f6-b112-147512f843ca
Jul 03 13:13:08 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:09 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7c467433-ba5a-4458-ab66-343840f96c2e tempest-VolumeTypesAccessTest-425469550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7b775cec-8f45-42f6-b112-147512f843ca" returned: 0 in 0.830s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7c467433-ba5a-4458-ab66-343840f96c2e tempest-VolumeTypesAccessTest-425469550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7b775cec-8f45-42f6-b112-147512f843ca {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:09 devstack sudo[99771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7b775cec-8f45-42f6-b112-147512f843ca
Jul 03 13:13:09 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:10 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7c467433-ba5a-4458-ab66-343840f96c2e tempest-VolumeTypesAccessTest-425469550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7b775cec-8f45-42f6-b112-147512f843ca" returned: 0 in 0.825s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:10 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7c467433-ba5a-4458-ab66-343840f96c2e tempest-VolumeTypesAccessTest-425469550 None] Lock "cinder-quobyte-7b775cec-8f45-42f6-b112-147512f843ca" released by "delete_volume" :: held 1.702s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:13:10 devstack cinder-volume[86837]: WARNING cinder.quota [None req-7c467433-ba5a-4458-ab66-343840f96c2e tempest-VolumeTypesAccessTest-425469550 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1113555136 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1113555136, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:13:10 devstack cinder-volume[86837]: WARNING cinder.quota [None req-7c467433-ba5a-4458-ab66-343840f96c2e tempest-VolumeTypesAccessTest-425469550 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1113555136 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1113555136, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:13:10 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-7c467433-ba5a-4458-ab66-343840f96c2e tempest-VolumeTypesAccessTest-425469550 None] Created reservations ['95993f17-66dd-4a9f-a0ca-4b25c0394ed0', '821d267c-65d4-416a-bf3b-7efd3bb39412', '55d13496-f18a-4951-823f-e77b01941992', 'a5e89c10-56b4-43d0-94ae-d8bf1f882dad'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:13:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-7c467433-ba5a-4458-ab66-343840f96c2e tempest-VolumeTypesAccessTest-425469550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-7c467433-ba5a-4458-ab66-343840f96c2e tempest-VolumeTypesAccessTest-425469550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:10 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-7c467433-ba5a-4458-ab66-343840f96c2e tempest-VolumeTypesAccessTest-425469550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:10 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-7c467433-ba5a-4458-ab66-343840f96c2e tempest-VolumeTypesAccessTest-425469550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-7c467433-ba5a-4458-ab66-343840f96c2e tempest-VolumeTypesAccessTest-425469550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7c467433-ba5a-4458-ab66-343840f96c2e tempest-VolumeTypesAccessTest-425469550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:10 devstack sudo[99774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:13:10 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:11 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7c467433-ba5a-4458-ab66-343840f96c2e tempest-VolumeTypesAccessTest-425469550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.378s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:11 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-7c467433-ba5a-4458-ab66-343840f96c2e tempest-VolumeTypesAccessTest-425469550 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:13:11 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-7c467433-ba5a-4458-ab66-343840f96c2e tempest-VolumeTypesAccessTest-425469550 None] Deleted volume successfully.
Jul 03 13:13:11 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7c467433-ba5a-4458-ab66-343840f96c2e tempest-VolumeTypesAccessTest-425469550 None] Lock "cinder-7b775cec-8f45-42f6-b112-147512f843ca-delete_volume" released by "delete_volume" :: held 3.440s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:13:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:13:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:14 devstack sudo[99809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:13:14 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:15 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.915s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:15 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:13:15 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:13:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 28 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:13:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>, <Thread(tpool_thread_0, started daemon 134850092431040)>, <Thread(tpool_thread_1, started daemon 134850084021952)>, <Thread(tpool_thread_2, started daemon 134850075612864)>, <Thread(tpool_thread_3, started daemon 134850067203776)>, <Thread(tpool_thread_4, started daemon 134850058794688)>, <Thread(tpool_thread_5, started daemon 134850050385600)>, <Thread(tpool_thread_6, started daemon 134850041976512)>, <Thread(tpool_thread_7, started daemon 134850033567424)>, <Thread(tpool_thread_8, started daemon 134850025158336)>, <Thread(tpool_thread_9, started daemon 134850016749248)>, <Thread(tpool_thread_10, started daemon 134850008340160)>, <Thread(tpool_thread_11, started daemon 134849999931072)>, <Thread(tpool_thread_12, started daemon 134849991521984)>, <Thread(tpool_thread_13, started daemon 134849983112896)>, <Thread(tpool_thread_14, started daemon 134849974703808)>, <Thread(tpool_thread_15, started daemon 134849966294720)>, <Thread(tpool_thread_16, started daemon 134849957885632)>, <Thread(tpool_thread_17, started daemon 134849949476544)>, <Thread(tpool_thread_18, started daemon 134849941067456)>, <Thread(tpool_thread_19, started daemon 134849932658368)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:13:20 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=26,cinder:INSERT=12,cinder:UPDATE=38,cinder:DELETE=2 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:13:21 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=22,cinder:UPDATE=34,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:13:23 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:13:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Flow 'volume_create_manager' (24706997-05dd-4714-a85d-954c071ef35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ffb39f-c3e4-40a5-be94-81f012d5463f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ffb39f-c3e4-40a5-be94-81f012d5463f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1563681666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7726eea3-dc58-4820-bcdc-b03a85565c80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0accce84706436eaff51b89adda23f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:24Z,use_quota=True,user_id='9177c67981a24a9c885a7f98436a8b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a483eb22-42a4-422c-b4aa-92ba27749c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a483eb22-42a4-422c-b4aa-92ba27749c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfceab75-d191-4b5e-91d7-948ed1676fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfceab75-d191-4b5e-91d7-948ed1676fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7726eea3-dc58-4820-bcdc-b03a85565c80', 'volume_name': 'volume-7726eea3-dc58-4820-bcdc-b03a85565c80', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f30ee0-a999-45c9-a6f2-b52027cb3ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f30ee0-a999-45c9-a6f2-b52027cb3ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59cb1ca2-d481-40d8-a525-c6bc91283c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:24 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Volume 7726eea3-dc58-4820-bcdc-b03a85565c80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7726eea3-dc58-4820-bcdc-b03a85565c80', 'volume_size': 1}
Jul 03 13:13:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1563681666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7726eea3-dc58-4820-bcdc-b03a85565c80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0accce84706436eaff51b89adda23f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:24Z,use_quota=True,user_id='9177c67981a24a9c885a7f98436a8b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:13:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Creating volume 7726eea3-dc58-4820-bcdc-b03a85565c80 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:13:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:13:24 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:13:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7726eea3-dc58-4820-bcdc-b03a85565c80 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:24 devstack sudo[99925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7726eea3-dc58-4820-bcdc-b03a85565c80 1073741824
Jul 03 13:13:24 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:25 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7726eea3-dc58-4820-bcdc-b03a85565c80 1073741824" returned: 0 in 1.321s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:25 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:13:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Flow 'volume_create_manager' (de38ff53-d234-4dd6-8a45-0d5447377d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81683a08-6e81-4a31-9c22-d1d8643e8cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81683a08-6e81-4a31-9c22-d1d8643e8cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1485282371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04fed405-d5f3-4753-9730-10f095e559ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d48b155cdfc4c64ad1242e06c82f471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:25Z,use_quota=True,user_id='6153a4b5ca51489c934dfb11cabf09c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91dc4cf-5568-4a89-a682-80c390220e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91dc4cf-5568-4a89-a682-80c390220e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d6f53c-188f-4dce-b201-9d82679a064a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d6f53c-188f-4dce-b201-9d82679a064a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04fed405-d5f3-4753-9730-10f095e559ab', 'volume_name': 'volume-04fed405-d5f3-4753-9730-10f095e559ab', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20037fed-1e70-43a7-be7c-7de052ca2197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20037fed-1e70-43a7-be7c-7de052ca2197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaafeea0-cca6-417a-9064-2d8afabb3a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:25 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Volume 04fed405-d5f3-4753-9730-10f095e559ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04fed405-d5f3-4753-9730-10f095e559ab', 'volume_size': 1}
Jul 03 13:13:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7726eea3-dc58-4820-bcdc-b03a85565c80 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:25 devstack sudo[99930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7726eea3-dc58-4820-bcdc-b03a85565c80
Jul 03 13:13:25 devstack sudo[99930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:26 devstack sudo[99930]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7726eea3-dc58-4820-bcdc-b03a85565c80" returned: 0 in 0.750s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] <== create_volume: return (2207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:13:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.211s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.781s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1485282371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04fed405-d5f3-4753-9730-10f095e559ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d48b155cdfc4c64ad1242e06c82f471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:25Z,use_quota=True,user_id='6153a4b5ca51489c934dfb11cabf09c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:13:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Creating volume 04fed405-d5f3-4753-9730-10f095e559ab {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:13:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:13:26 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:13:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-04fed405-d5f3-4753-9730-10f095e559ab 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59cb1ca2-d481-40d8-a525-c6bc91283c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7726eea3-dc58-4820-bcdc-b03a85565c80', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b02c8a11-948a-4b78-82bb-b5b361c71e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:26 devstack sudo[99933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-04fed405-d5f3-4753-9730-10f095e559ab 1073741824
Jul 03 13:13:26 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:26 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Volume volume-7726eea3-dc58-4820-bcdc-b03a85565c80 (7726eea3-dc58-4820-bcdc-b03a85565c80): created successfully
Jul 03 13:13:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b02c8a11-948a-4b78-82bb-b5b361c71e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Flow 'volume_create_manager' (24706997-05dd-4714-a85d-954c071ef35a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:26 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-737b3545-a1cb-4097-9352-05464efb1aa8 tempest-TestMinimumBasicScenario-266485820 None] Created volume successfully.
Jul 03 13:13:27 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-04fed405-d5f3-4753-9730-10f095e559ab 1073741824" returned: 0 in 1.347s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-04fed405-d5f3-4753-9730-10f095e559ab {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:27 devstack sudo[99942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-04fed405-d5f3-4753-9730-10f095e559ab
Jul 03 13:13:27 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:28 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-04fed405-d5f3-4753-9730-10f095e559ab" returned: 0 in 0.883s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:28 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] <== create_volume: return (2295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:13:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.298s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:28 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaafeea0-cca6-417a-9064-2d8afabb3a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04fed405-d5f3-4753-9730-10f095e559ab', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:28 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3df6e65-d883-4c8a-8c59-717012696447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:28 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Volume volume-04fed405-d5f3-4753-9730-10f095e559ab (04fed405-d5f3-4753-9730-10f095e559ab): created successfully
Jul 03 13:13:28 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3df6e65-d883-4c8a-8c59-717012696447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:28 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Flow 'volume_create_manager' (de38ff53-d234-4dd6-8a45-0d5447377d5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:28 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-b7cb22b3-ec13-43f3-a239-fd6fd06c131d tempest-VolumesListAdminTestJSON-2073423714 None] Created volume successfully.
Jul 03 13:13:29 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:13:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Flow 'volume_create_manager' (2e95b223-cc8f-4920-a29e-13b33eacae3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e4114de-c16a-4a8f-9048-f69855007141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e4114de-c16a-4a8f-9048-f69855007141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1533353599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=829905dd-6f0b-4557-bdab-a74cfc5f1109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0596af7ca6ea4c978b6d3d734e806131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:29Z,use_quota=True,user_id='9244b737317e43f98cfc79ab7bd58b6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e4368f-5ec1-416c-8098-4d0b484770dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e4368f-5ec1-416c-8098-4d0b484770dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504ad9d5-5bf8-4f38-a2c3-01a4d900aef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504ad9d5-5bf8-4f38-a2c3-01a4d900aef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '829905dd-6f0b-4557-bdab-a74cfc5f1109', 'volume_name': 'volume-829905dd-6f0b-4557-bdab-a74cfc5f1109', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8447b226-343c-4ac0-a9fe-c270c1ef4b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8447b226-343c-4ac0-a9fe-c270c1ef4b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7e936b-9815-4df4-9a10-4cfd12eebeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:29 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Volume 829905dd-6f0b-4557-bdab-a74cfc5f1109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-829905dd-6f0b-4557-bdab-a74cfc5f1109', 'volume_size': 1}
Jul 03 13:13:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:29 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1533353599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=829905dd-6f0b-4557-bdab-a74cfc5f1109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0596af7ca6ea4c978b6d3d734e806131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:29Z,use_quota=True,user_id='9244b737317e43f98cfc79ab7bd58b6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:13:29 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Creating volume 829905dd-6f0b-4557-bdab-a74cfc5f1109 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:13:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:29 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:29 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:29 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:13:29 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:13:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-829905dd-6f0b-4557-bdab-a74cfc5f1109 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:29 devstack sudo[99945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-829905dd-6f0b-4557-bdab-a74cfc5f1109 1073741824
Jul 03 13:13:29 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:30 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-829905dd-6f0b-4557-bdab-a74cfc5f1109 1073741824" returned: 0 in 1.210s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:30 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:13:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Flow 'volume_create_manager' (2cd47229-5363-445c-a523-c65c33a1a16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (943e4a36-371b-4416-90b3-a0d739cba681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (943e4a36-371b-4416-90b3-a0d739cba681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-737128404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e1cf4bc-3403-4f42-ab51-e8f558a484d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d48b155cdfc4c64ad1242e06c82f471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:30Z,use_quota=True,user_id='6153a4b5ca51489c934dfb11cabf09c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a44ecf27-1e4b-47bb-aa03-5884a3f442cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a44ecf27-1e4b-47bb-aa03-5884a3f442cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a62c86-b82a-4242-9f05-cff4b36baa50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a62c86-b82a-4242-9f05-cff4b36baa50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e1cf4bc-3403-4f42-ab51-e8f558a484d2', 'volume_name': 'volume-9e1cf4bc-3403-4f42-ab51-e8f558a484d2', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d769660d-2885-43ba-a00c-bac5d2f5d7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d769660d-2885-43ba-a00c-bac5d2f5d7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4de5716-9b9c-4b38-96fa-45e38a99c5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:30 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Volume 9e1cf4bc-3403-4f42-ab51-e8f558a484d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e1cf4bc-3403-4f42-ab51-e8f558a484d2', 'volume_size': 1}
Jul 03 13:13:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-2460cd8b-69b5-4947-a921-8b44355b5e4c req-9f011ebf-2f80-48d6-bea4-0184f6320e5f tempest-TestMinimumBasicScenario-266485820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-829905dd-6f0b-4557-bdab-a74cfc5f1109 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:30 devstack sudo[99959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-829905dd-6f0b-4557-bdab-a74cfc5f1109
Jul 03 13:13:30 devstack sudo[99959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:31 devstack sudo[99959]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-829905dd-6f0b-4557-bdab-a74cfc5f1109" returned: 0 in 0.724s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:13:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.082s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.757s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-737128404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e1cf4bc-3403-4f42-ab51-e8f558a484d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d48b155cdfc4c64ad1242e06c82f471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:30Z,use_quota=True,user_id='6153a4b5ca51489c934dfb11cabf09c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:13:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Creating volume 9e1cf4bc-3403-4f42-ab51-e8f558a484d2 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:13:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:13:31 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:13:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9e1cf4bc-3403-4f42-ab51-e8f558a484d2 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7e936b-9815-4df4-9a10-4cfd12eebeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-829905dd-6f0b-4557-bdab-a74cfc5f1109', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:31 devstack sudo[99962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9e1cf4bc-3403-4f42-ab51-e8f558a484d2 1073741824
Jul 03 13:13:31 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426cfea5-819a-4905-a671-b2e0f2e9eef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:31 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Volume volume-829905dd-6f0b-4557-bdab-a74cfc5f1109 (829905dd-6f0b-4557-bdab-a74cfc5f1109): created successfully
Jul 03 13:13:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426cfea5-819a-4905-a671-b2e0f2e9eef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Flow 'volume_create_manager' (2e95b223-cc8f-4920-a29e-13b33eacae3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:31 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-176680c4-b947-48f7-80de-a1e882871265 tempest-VolumesTransfersV357Test-990675151 None] Created volume successfully.
Jul 03 13:13:32 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9e1cf4bc-3403-4f42-ab51-e8f558a484d2 1073741824" returned: 0 in 0.889s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9e1cf4bc-3403-4f42-ab51-e8f558a484d2 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:32 devstack sudo[99967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9e1cf4bc-3403-4f42-ab51-e8f558a484d2
Jul 03 13:13:32 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:33 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9e1cf4bc-3403-4f42-ab51-e8f558a484d2" returned: 0 in 0.703s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:33 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:13:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-2460cd8b-69b5-4947-a921-8b44355b5e4c req-9f011ebf-2f80-48d6-bea4-0184f6320e5f tempest-TestMinimumBasicScenario-266485820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.404s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4de5716-9b9c-4b38-96fa-45e38a99c5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e1cf4bc-3403-4f42-ab51-e8f558a484d2', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d3ccf5-15b5-400b-84e9-46a70f63c2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:33 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b475b5f-e900-4f00-88df-3dacd4c76fcb]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:13:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-2460cd8b-69b5-4947-a921-8b44355b5e4c req-9f011ebf-2f80-48d6-bea4-0184f6320e5f tempest-TestMinimumBasicScenario-266485820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7726eea3-dc58-4820-bcdc-b03a85565c80 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:33 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Volume volume-9e1cf4bc-3403-4f42-ab51-e8f558a484d2 (9e1cf4bc-3403-4f42-ab51-e8f558a484d2): created successfully
Jul 03 13:13:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d3ccf5-15b5-400b-84e9-46a70f63c2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Flow 'volume_create_manager' (2cd47229-5363-445c-a523-c65c33a1a16a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:33 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-f224da21-8d11-4218-807a-1a807a276665 tempest-VolumesListAdminTestJSON-2073423714 None] Created volume successfully.
Jul 03 13:13:33 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-26e3072f-cdf8-49ba-8158-eac6454ffffe tempest-VolumesTransfersV357Test-94215138 None] Transfer volume completed successfully.
Jul 03 13:13:33 devstack sudo[99971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7726eea3-dc58-4820-bcdc-b03a85565c80
Jul 03 13:13:33 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:33 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-2460cd8b-69b5-4947-a921-8b44355b5e4c req-9f011ebf-2f80-48d6-bea4-0184f6320e5f tempest-TestMinimumBasicScenario-266485820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7726eea3-dc58-4820-bcdc-b03a85565c80" returned: 0 in 0.862s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-2460cd8b-69b5-4947-a921-8b44355b5e4c req-9f011ebf-2f80-48d6-bea4-0184f6320e5f tempest-TestMinimumBasicScenario-266485820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.897s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-2460cd8b-69b5-4947-a921-8b44355b5e4c req-9f011ebf-2f80-48d6-bea4-0184f6320e5f tempest-TestMinimumBasicScenario-266485820 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db', 'name': 'volume-7726eea3-dc58-4820-bcdc-b03a85565c80', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f2f94d89-5699-43a8-b7fb-55c2538dc9c4', 'enforce_multipath': True} {{(pid=86837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 13:13:34 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-2460cd8b-69b5-4947-a921-8b44355b5e4c req-9f011ebf-2f80-48d6-bea4-0184f6320e5f tempest-TestMinimumBasicScenario-266485820 None] attachment_update completed successfully.
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2a4a6ca9-6fcd-4a95-ba48-524e9221ff87 tempest-VolumesTransfersV357Test-1234169959 None] Acquiring lock "cinder-829905dd-6f0b-4557-bdab-a74cfc5f1109-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2a4a6ca9-6fcd-4a95-ba48-524e9221ff87 tempest-VolumesTransfersV357Test-1234169959 None] Lock "cinder-829905dd-6f0b-4557-bdab-a74cfc5f1109-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2a4a6ca9-6fcd-4a95-ba48-524e9221ff87 tempest-VolumesTransfersV357Test-1234169959 None] Acquiring lock "cinder-quobyte-829905dd-6f0b-4557-bdab-a74cfc5f1109" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2a4a6ca9-6fcd-4a95-ba48-524e9221ff87 tempest-VolumesTransfersV357Test-1234169959 None] Lock "cinder-quobyte-829905dd-6f0b-4557-bdab-a74cfc5f1109" acquired by "delete_volume" :: waited 0.018s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25b7442-6e04-4f22-a623-3d0a5ea0b187]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2a4a6ca9-6fcd-4a95-ba48-524e9221ff87 tempest-VolumesTransfersV357Test-1234169959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-829905dd-6f0b-4557-bdab-a74cfc5f1109 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:34 devstack sudo[100059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-829905dd-6f0b-4557-bdab-a74cfc5f1109
Jul 03 13:13:34 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Flow 'volume_create_manager' (08cdefa0-c590-45cf-92a1-dcea32b7fae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ce1fa4a-068a-4a1f-8f8d-812362becc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ce1fa4a-068a-4a1f-8f8d-812362becc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1888102589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86ac17f4-bb34-48ce-80bf-b81e6b172e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d48b155cdfc4c64ad1242e06c82f471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:35Z,use_quota=True,user_id='6153a4b5ca51489c934dfb11cabf09c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (150c60da-fc0d-4496-9c36-024368d303ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (150c60da-fc0d-4496-9c36-024368d303ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a6073c-5f93-408f-956f-c77c23ae8791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a6073c-5f93-408f-956f-c77c23ae8791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86ac17f4-bb34-48ce-80bf-b81e6b172e52', 'volume_name': 'volume-86ac17f4-bb34-48ce-80bf-b81e6b172e52', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5314c3fd-e0c9-4a8b-bf73-fc9ba4f3e8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5314c3fd-e0c9-4a8b-bf73-fc9ba4f3e8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e310b557-4619-4f9d-bbe7-774988fe9e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:34 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Volume 86ac17f4-bb34-48ce-80bf-b81e6b172e52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86ac17f4-bb34-48ce-80bf-b81e6b172e52', 'volume_size': 1}
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1888102589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86ac17f4-bb34-48ce-80bf-b81e6b172e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d48b155cdfc4c64ad1242e06c82f471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:35Z,use_quota=True,user_id='6153a4b5ca51489c934dfb11cabf09c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Creating volume 86ac17f4-bb34-48ce-80bf-b81e6b172e52 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:13:34 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:13:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-86ac17f4-bb34-48ce-80bf-b81e6b172e52 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:34 devstack sudo[100061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-86ac17f4-bb34-48ce-80bf-b81e6b172e52 1073741824
Jul 03 13:13:34 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:35 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2a4a6ca9-6fcd-4a95-ba48-524e9221ff87 tempest-VolumesTransfersV357Test-1234169959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-829905dd-6f0b-4557-bdab-a74cfc5f1109" returned: 0 in 0.841s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2a4a6ca9-6fcd-4a95-ba48-524e9221ff87 tempest-VolumesTransfersV357Test-1234169959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-829905dd-6f0b-4557-bdab-a74cfc5f1109 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:35 devstack sudo[100381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-829905dd-6f0b-4557-bdab-a74cfc5f1109
Jul 03 13:13:35 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:35 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-86ac17f4-bb34-48ce-80bf-b81e6b172e52 1073741824" returned: 0 in 0.968s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-86ac17f4-bb34-48ce-80bf-b81e6b172e52 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:35 devstack sudo[100386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-86ac17f4-bb34-48ce-80bf-b81e6b172e52
Jul 03 13:13:35 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:36 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2a4a6ca9-6fcd-4a95-ba48-524e9221ff87 tempest-VolumesTransfersV357Test-1234169959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-829905dd-6f0b-4557-bdab-a74cfc5f1109" returned: 0 in 0.708s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:36 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2a4a6ca9-6fcd-4a95-ba48-524e9221ff87 tempest-VolumesTransfersV357Test-1234169959 None] Lock "cinder-quobyte-829905dd-6f0b-4557-bdab-a74cfc5f1109" released by "delete_volume" :: held 1.603s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:13:36 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-2a4a6ca9-6fcd-4a95-ba48-524e9221ff87 tempest-VolumesTransfersV357Test-1234169959 None] Created reservations ['4b4d394d-0ba9-47b2-a45c-7f1a72e35d6e', '3c2fe11e-f6c7-4f72-9700-bde0e1217a59', '96f60b5d-b607-4782-b6b2-1e9fce5ee2ec', 'd0172e26-e1d4-4ef4-b4c2-ccde7fd25b53'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:13:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-2a4a6ca9-6fcd-4a95-ba48-524e9221ff87 tempest-VolumesTransfersV357Test-1234169959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-2a4a6ca9-6fcd-4a95-ba48-524e9221ff87 tempest-VolumesTransfersV357Test-1234169959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-2a4a6ca9-6fcd-4a95-ba48-524e9221ff87 tempest-VolumesTransfersV357Test-1234169959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-2a4a6ca9-6fcd-4a95-ba48-524e9221ff87 tempest-VolumesTransfersV357Test-1234169959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-2a4a6ca9-6fcd-4a95-ba48-524e9221ff87 tempest-VolumesTransfersV357Test-1234169959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2a4a6ca9-6fcd-4a95-ba48-524e9221ff87 tempest-VolumesTransfersV357Test-1234169959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:36 devstack sudo[100389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:13:36 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:36 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-86ac17f4-bb34-48ce-80bf-b81e6b172e52" returned: 0 in 0.725s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:13:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e310b557-4619-4f9d-bbe7-774988fe9e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86ac17f4-bb34-48ce-80bf-b81e6b172e52', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c10eeb0-10bc-449c-bc95-07b64c2817e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:36 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Volume volume-86ac17f4-bb34-48ce-80bf-b81e6b172e52 (86ac17f4-bb34-48ce-80bf-b81e6b172e52): created successfully
Jul 03 13:13:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c10eeb0-10bc-449c-bc95-07b64c2817e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Flow 'volume_create_manager' (08cdefa0-c590-45cf-92a1-dcea32b7fae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:36 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-9f1bc13b-9256-479e-a394-a02c48d4848f tempest-VolumesListAdminTestJSON-2073423714 None] Created volume successfully.
Jul 03 13:13:36 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2a4a6ca9-6fcd-4a95-ba48-524e9221ff87 tempest-VolumesTransfersV357Test-1234169959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.695s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:36 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-2a4a6ca9-6fcd-4a95-ba48-524e9221ff87 tempest-VolumesTransfersV357Test-1234169959 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:13:36 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-2a4a6ca9-6fcd-4a95-ba48-524e9221ff87 tempest-VolumesTransfersV357Test-1234169959 None] Deleted volume successfully.
Jul 03 13:13:36 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2a4a6ca9-6fcd-4a95-ba48-524e9221ff87 tempest-VolumesTransfersV357Test-1234169959 None] Lock "cinder-829905dd-6f0b-4557-bdab-a74cfc5f1109-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Flow 'volume_create_manager' (42b4808d-cc62-4b79-9d50-aadaededd0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e15cc187-0313-45dd-b1e8-3123ec5b446f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e15cc187-0313-45dd-b1e8-3123ec5b446f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-899426283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=902c5e5e-ea73-47dd-918a-66e685c30b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0596af7ca6ea4c978b6d3d734e806131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:37Z,use_quota=True,user_id='9244b737317e43f98cfc79ab7bd58b6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1524713d-0b7c-4cda-a0c8-537fe0279b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1524713d-0b7c-4cda-a0c8-537fe0279b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a23bea-882e-4dd0-9016-678a8e9c1392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a23bea-882e-4dd0-9016-678a8e9c1392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '902c5e5e-ea73-47dd-918a-66e685c30b2a', 'volume_name': 'volume-902c5e5e-ea73-47dd-918a-66e685c30b2a', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d6d4c1-e5f6-4416-a300-5f07495f9383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d6d4c1-e5f6-4416-a300-5f07495f9383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f30012b7-86d9-4ed5-9e88-ca7309d06107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:37 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Volume 902c5e5e-ea73-47dd-918a-66e685c30b2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-902c5e5e-ea73-47dd-918a-66e685c30b2a', 'volume_size': 1}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-899426283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=902c5e5e-ea73-47dd-918a-66e685c30b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0596af7ca6ea4c978b6d3d734e806131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:37Z,use_quota=True,user_id='9244b737317e43f98cfc79ab7bd58b6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Creating volume 902c5e5e-ea73-47dd-918a-66e685c30b2a {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:13:37 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-902c5e5e-ea73-47dd-918a-66e685c30b2a 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:37 devstack sudo[100393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-902c5e5e-ea73-47dd-918a-66e685c30b2a 1073741824
Jul 03 13:13:37 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Flow 'volume_create_manager' (27cad41f-a506-490f-833a-d445b908ee5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac398d2-d115-46c5-878b-b7d1a3a3b10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac398d2-d115-46c5-878b-b7d1a3a3b10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2872ad0-f0fc-44a0-9daf-03cfe65268b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d50d23c0ec64716bf1a32b3cf4d2201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:38Z,use_quota=True,user_id='b410fb2ad5f4407caed816b96271121d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84bb56fb-68c3-4e3e-b21d-c61a7e27b9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84bb56fb-68c3-4e3e-b21d-c61a7e27b9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5646eb4-5e81-4f06-81c6-45d8674a0afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5646eb4-5e81-4f06-81c6-45d8674a0afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2872ad0-f0fc-44a0-9daf-03cfe65268b0', 'volume_name': 'volume-d2872ad0-f0fc-44a0-9daf-03cfe65268b0', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2028d6b5-ad9b-4b6a-872c-e0c5e83d0e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2028d6b5-ad9b-4b6a-872c-e0c5e83d0e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33811e6d-69cf-4322-969f-cbf567d710af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:37 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Volume d2872ad0-f0fc-44a0-9daf-03cfe65268b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2872ad0-f0fc-44a0-9daf-03cfe65268b0', 'volume_size': 1}
Jul 03 13:13:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:38 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-902c5e5e-ea73-47dd-918a-66e685c30b2a 1073741824" returned: 0 in 1.060s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-902c5e5e-ea73-47dd-918a-66e685c30b2a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:38 devstack sudo[100399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-902c5e5e-ea73-47dd-918a-66e685c30b2a
Jul 03 13:13:38 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:39 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-902c5e5e-ea73-47dd-918a-66e685c30b2a" returned: 0 in 0.761s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:13:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.513s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2872ad0-f0fc-44a0-9daf-03cfe65268b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d50d23c0ec64716bf1a32b3cf4d2201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:38Z,use_quota=True,user_id='b410fb2ad5f4407caed816b96271121d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:13:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Creating volume d2872ad0-f0fc-44a0-9daf-03cfe65268b0 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:13:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:13:39 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:13:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d2872ad0-f0fc-44a0-9daf-03cfe65268b0 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f30012b7-86d9-4ed5-9e88-ca7309d06107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-902c5e5e-ea73-47dd-918a-66e685c30b2a', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:39 devstack sudo[100408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d2872ad0-f0fc-44a0-9daf-03cfe65268b0 1073741824
Jul 03 13:13:39 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (123a5c8b-61c6-40d7-a6cb-0d50edd22fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:39 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Volume volume-902c5e5e-ea73-47dd-918a-66e685c30b2a (902c5e5e-ea73-47dd-918a-66e685c30b2a): created successfully
Jul 03 13:13:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (123a5c8b-61c6-40d7-a6cb-0d50edd22fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Flow 'volume_create_manager' (42b4808d-cc62-4b79-9d50-aadaededd0b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:39 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-9fb7dc16-3256-49a1-a4ec-d1b56b0fa206 tempest-VolumesTransfersV357Test-990675151 None] Created volume successfully.
Jul 03 13:13:40 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d2872ad0-f0fc-44a0-9daf-03cfe65268b0 1073741824" returned: 0 in 1.117s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d2872ad0-f0fc-44a0-9daf-03cfe65268b0 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:40 devstack sudo[100414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d2872ad0-f0fc-44a0-9daf-03cfe65268b0
Jul 03 13:13:40 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-468eeee3-ebe3-4561-8f1f-67e7054285bf tempest-VolumesTransfersV357Test-1234169959 None] Acquiring lock "cinder-902c5e5e-ea73-47dd-918a-66e685c30b2a-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:13:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-468eeee3-ebe3-4561-8f1f-67e7054285bf tempest-VolumesTransfersV357Test-1234169959 None] Lock "cinder-902c5e5e-ea73-47dd-918a-66e685c30b2a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:13:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-468eeee3-ebe3-4561-8f1f-67e7054285bf tempest-VolumesTransfersV357Test-1234169959 None] Acquiring lock "cinder-quobyte-902c5e5e-ea73-47dd-918a-66e685c30b2a" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:13:41 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-468eeee3-ebe3-4561-8f1f-67e7054285bf tempest-VolumesTransfersV357Test-1234169959 None] Lock "cinder-quobyte-902c5e5e-ea73-47dd-918a-66e685c30b2a" acquired by "delete_volume" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:13:41 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[4decaed9-207b-4a95-98b8-fa7caddde015]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:13:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-468eeee3-ebe3-4561-8f1f-67e7054285bf tempest-VolumesTransfersV357Test-1234169959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-902c5e5e-ea73-47dd-918a-66e685c30b2a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:41 devstack sudo[100416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-902c5e5e-ea73-47dd-918a-66e685c30b2a
Jul 03 13:13:41 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:41 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d2872ad0-f0fc-44a0-9daf-03cfe65268b0" returned: 0 in 0.925s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] <== create_volume: return (2118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:13:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.120s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33811e6d-69cf-4322-969f-cbf567d710af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2872ad0-f0fc-44a0-9daf-03cfe65268b0', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f973e2-cdcc-4d5c-b15d-0e13eb2e8712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:41 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Volume volume-d2872ad0-f0fc-44a0-9daf-03cfe65268b0 (d2872ad0-f0fc-44a0-9daf-03cfe65268b0): created successfully
Jul 03 13:13:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f973e2-cdcc-4d5c-b15d-0e13eb2e8712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Flow 'volume_create_manager' (27cad41f-a506-490f-833a-d445b908ee5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:41 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-9af86993-dd35-446a-b75a-57a65246efd5 tempest-VolumesListAdminTestJSON-232403039 None] Created volume successfully.
Jul 03 13:13:42 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-468eeee3-ebe3-4561-8f1f-67e7054285bf tempest-VolumesTransfersV357Test-1234169959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-902c5e5e-ea73-47dd-918a-66e685c30b2a" returned: 0 in 1.029s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-468eeee3-ebe3-4561-8f1f-67e7054285bf tempest-VolumesTransfersV357Test-1234169959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-902c5e5e-ea73-47dd-918a-66e685c30b2a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:42 devstack sudo[100424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-902c5e5e-ea73-47dd-918a-66e685c30b2a
Jul 03 13:13:42 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-369d898c-6c66-4cae-88aa-0f174c28d206 tempest-VolumesListAdminTestJSON-232403039 None] Acquiring lock "cinder-d2872ad0-f0fc-44a0-9daf-03cfe65268b0-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:13:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-369d898c-6c66-4cae-88aa-0f174c28d206 tempest-VolumesListAdminTestJSON-232403039 None] Lock "cinder-d2872ad0-f0fc-44a0-9daf-03cfe65268b0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:13:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-369d898c-6c66-4cae-88aa-0f174c28d206 tempest-VolumesListAdminTestJSON-232403039 None] Acquiring lock "cinder-quobyte-d2872ad0-f0fc-44a0-9daf-03cfe65268b0" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:13:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-369d898c-6c66-4cae-88aa-0f174c28d206 tempest-VolumesListAdminTestJSON-232403039 None] Lock "cinder-quobyte-d2872ad0-f0fc-44a0-9daf-03cfe65268b0" acquired by "delete_volume" :: waited 0.018s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:13:42 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0649e0-dc09-4319-a03f-1856fe594234]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:13:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-369d898c-6c66-4cae-88aa-0f174c28d206 tempest-VolumesListAdminTestJSON-232403039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d2872ad0-f0fc-44a0-9daf-03cfe65268b0 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-11860df2-0316-434a-8452-aa53696616c2 tempest-VolumesListAdminTestJSON-2073423714 None] Acquiring lock "cinder-86ac17f4-bb34-48ce-80bf-b81e6b172e52-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:13:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-11860df2-0316-434a-8452-aa53696616c2 tempest-VolumesListAdminTestJSON-2073423714 None] Lock "cinder-86ac17f4-bb34-48ce-80bf-b81e6b172e52-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:13:42 devstack sudo[100426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d2872ad0-f0fc-44a0-9daf-03cfe65268b0
Jul 03 13:13:42 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-11860df2-0316-434a-8452-aa53696616c2 tempest-VolumesListAdminTestJSON-2073423714 None] Acquiring lock "cinder-quobyte-86ac17f4-bb34-48ce-80bf-b81e6b172e52" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:13:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-11860df2-0316-434a-8452-aa53696616c2 tempest-VolumesListAdminTestJSON-2073423714 None] Lock "cinder-quobyte-86ac17f4-bb34-48ce-80bf-b81e6b172e52" acquired by "delete_volume" :: waited 0.028s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:13:42 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44161e1-727d-4478-9286-4a07e6501e32]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:13:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-11860df2-0316-434a-8452-aa53696616c2 tempest-VolumesListAdminTestJSON-2073423714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-86ac17f4-bb34-48ce-80bf-b81e6b172e52 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:42 devstack sudo[100428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-86ac17f4-bb34-48ce-80bf-b81e6b172e52
Jul 03 13:13:42 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:43 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-468eeee3-ebe3-4561-8f1f-67e7054285bf tempest-VolumesTransfersV357Test-1234169959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-902c5e5e-ea73-47dd-918a-66e685c30b2a" returned: 0 in 1.024s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:43 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-468eeee3-ebe3-4561-8f1f-67e7054285bf tempest-VolumesTransfersV357Test-1234169959 None] Lock "cinder-quobyte-902c5e5e-ea73-47dd-918a-66e685c30b2a" released by "delete_volume" :: held 2.117s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:13:43 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-468eeee3-ebe3-4561-8f1f-67e7054285bf tempest-VolumesTransfersV357Test-1234169959 None] Created reservations ['f04fd94b-342d-4bfd-ba3a-27eb9eef076d', 'b77ed854-d54f-49c8-a4f5-3da45b72fe30', 'dcacf0b3-fac8-4d6f-b218-735869a57eb8', '04d9e117-4d78-426f-9d53-a75b4571be45'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:13:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-468eeee3-ebe3-4561-8f1f-67e7054285bf tempest-VolumesTransfersV357Test-1234169959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-468eeee3-ebe3-4561-8f1f-67e7054285bf tempest-VolumesTransfersV357Test-1234169959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:43 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-468eeee3-ebe3-4561-8f1f-67e7054285bf tempest-VolumesTransfersV357Test-1234169959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:43 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-468eeee3-ebe3-4561-8f1f-67e7054285bf tempest-VolumesTransfersV357Test-1234169959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-468eeee3-ebe3-4561-8f1f-67e7054285bf tempest-VolumesTransfersV357Test-1234169959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-468eeee3-ebe3-4561-8f1f-67e7054285bf tempest-VolumesTransfersV357Test-1234169959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:43 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-369d898c-6c66-4cae-88aa-0f174c28d206 tempest-VolumesListAdminTestJSON-232403039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d2872ad0-f0fc-44a0-9daf-03cfe65268b0" returned: 0 in 1.049s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-369d898c-6c66-4cae-88aa-0f174c28d206 tempest-VolumesListAdminTestJSON-232403039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d2872ad0-f0fc-44a0-9daf-03cfe65268b0 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:43 devstack sudo[100436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:13:43 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:43 devstack sudo[100438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d2872ad0-f0fc-44a0-9daf-03cfe65268b0
Jul 03 13:13:43 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:43 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-11860df2-0316-434a-8452-aa53696616c2 tempest-VolumesListAdminTestJSON-2073423714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-86ac17f4-bb34-48ce-80bf-b81e6b172e52" returned: 0 in 1.395s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-11860df2-0316-434a-8452-aa53696616c2 tempest-VolumesListAdminTestJSON-2073423714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-86ac17f4-bb34-48ce-80bf-b81e6b172e52 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:44 devstack sudo[100443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-86ac17f4-bb34-48ce-80bf-b81e6b172e52
Jul 03 13:13:44 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:44 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-468eeee3-ebe3-4561-8f1f-67e7054285bf tempest-VolumesTransfersV357Test-1234169959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.916s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:44 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-468eeee3-ebe3-4561-8f1f-67e7054285bf tempest-VolumesTransfersV357Test-1234169959 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:13:44 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-468eeee3-ebe3-4561-8f1f-67e7054285bf tempest-VolumesTransfersV357Test-1234169959 None] Deleted volume successfully.
Jul 03 13:13:44 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-468eeee3-ebe3-4561-8f1f-67e7054285bf tempest-VolumesTransfersV357Test-1234169959 None] Lock "cinder-902c5e5e-ea73-47dd-918a-66e685c30b2a-delete_volume" released by "delete_volume" :: held 3.442s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:13:44 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-369d898c-6c66-4cae-88aa-0f174c28d206 tempest-VolumesListAdminTestJSON-232403039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d2872ad0-f0fc-44a0-9daf-03cfe65268b0" returned: 0 in 1.088s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:44 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-369d898c-6c66-4cae-88aa-0f174c28d206 tempest-VolumesListAdminTestJSON-232403039 None] Lock "cinder-quobyte-d2872ad0-f0fc-44a0-9daf-03cfe65268b0" released by "delete_volume" :: held 2.203s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:13:44 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-369d898c-6c66-4cae-88aa-0f174c28d206 tempest-VolumesListAdminTestJSON-232403039 None] Created reservations ['9b779db9-bc29-4fdf-bd6a-1079085912f9', 'fcbf94f4-4e4b-4177-b296-1be72a0faca4', '508ec6d3-90ed-40b5-8ddf-3f8cc2ca8b69', '78623c7d-fb28-4018-9d48-4073abce2721'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:13:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-369d898c-6c66-4cae-88aa-0f174c28d206 tempest-VolumesListAdminTestJSON-232403039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-369d898c-6c66-4cae-88aa-0f174c28d206 tempest-VolumesListAdminTestJSON-232403039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-369d898c-6c66-4cae-88aa-0f174c28d206 tempest-VolumesListAdminTestJSON-232403039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-369d898c-6c66-4cae-88aa-0f174c28d206 tempest-VolumesListAdminTestJSON-232403039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-369d898c-6c66-4cae-88aa-0f174c28d206 tempest-VolumesListAdminTestJSON-232403039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-369d898c-6c66-4cae-88aa-0f174c28d206 tempest-VolumesListAdminTestJSON-232403039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:44 devstack sudo[100447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:13:44 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:44 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-11860df2-0316-434a-8452-aa53696616c2 tempest-VolumesListAdminTestJSON-2073423714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-86ac17f4-bb34-48ce-80bf-b81e6b172e52" returned: 0 in 0.938s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:44 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-11860df2-0316-434a-8452-aa53696616c2 tempest-VolumesListAdminTestJSON-2073423714 None] Lock "cinder-quobyte-86ac17f4-bb34-48ce-80bf-b81e6b172e52" released by "delete_volume" :: held 2.398s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:13:45 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-11860df2-0316-434a-8452-aa53696616c2 tempest-VolumesListAdminTestJSON-2073423714 None] Created reservations ['7e7b32b0-8f21-492d-bc30-06717da71513', '9ac4a7ce-0e2a-4f89-9732-b020d751b4ef', 'ef8f3431-76c3-443d-8ff8-27607e6022ca', '496053a7-b8ad-422e-8fdf-565f7325d18e'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:13:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-11860df2-0316-434a-8452-aa53696616c2 tempest-VolumesListAdminTestJSON-2073423714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-11860df2-0316-434a-8452-aa53696616c2 tempest-VolumesListAdminTestJSON-2073423714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:45 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-11860df2-0316-434a-8452-aa53696616c2 tempest-VolumesListAdminTestJSON-2073423714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:45 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-11860df2-0316-434a-8452-aa53696616c2 tempest-VolumesListAdminTestJSON-2073423714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-11860df2-0316-434a-8452-aa53696616c2 tempest-VolumesListAdminTestJSON-2073423714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-11860df2-0316-434a-8452-aa53696616c2 tempest-VolumesListAdminTestJSON-2073423714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:45 devstack sudo[100450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:13:45 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:45 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-369d898c-6c66-4cae-88aa-0f174c28d206 tempest-VolumesListAdminTestJSON-232403039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.840s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:45 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-369d898c-6c66-4cae-88aa-0f174c28d206 tempest-VolumesListAdminTestJSON-232403039 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:13:45 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-369d898c-6c66-4cae-88aa-0f174c28d206 tempest-VolumesListAdminTestJSON-232403039 None] Deleted volume successfully.
Jul 03 13:13:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-369d898c-6c66-4cae-88aa-0f174c28d206 tempest-VolumesListAdminTestJSON-232403039 None] Lock "cinder-d2872ad0-f0fc-44a0-9daf-03cfe65268b0-delete_volume" released by "delete_volume" :: held 3.366s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:13:45 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-11860df2-0316-434a-8452-aa53696616c2 tempest-VolumesListAdminTestJSON-2073423714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.763s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:45 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-11860df2-0316-434a-8452-aa53696616c2 tempest-VolumesListAdminTestJSON-2073423714 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:13:45 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-11860df2-0316-434a-8452-aa53696616c2 tempest-VolumesListAdminTestJSON-2073423714 None] Deleted volume successfully.
Jul 03 13:13:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-11860df2-0316-434a-8452-aa53696616c2 tempest-VolumesListAdminTestJSON-2073423714 None] Lock "cinder-86ac17f4-bb34-48ce-80bf-b81e6b172e52-delete_volume" released by "delete_volume" :: held 3.491s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:13:46 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-56877eaa-de2b-45d5-9e7d-dc73d607fc27 tempest-VolumesListAdminTestJSON-2073423714 None] Acquiring lock "cinder-9e1cf4bc-3403-4f42-ab51-e8f558a484d2-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:13:46 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-56877eaa-de2b-45d5-9e7d-dc73d607fc27 tempest-VolumesListAdminTestJSON-2073423714 None] Lock "cinder-9e1cf4bc-3403-4f42-ab51-e8f558a484d2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:13:46 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-56877eaa-de2b-45d5-9e7d-dc73d607fc27 tempest-VolumesListAdminTestJSON-2073423714 None] Acquiring lock "cinder-quobyte-9e1cf4bc-3403-4f42-ab51-e8f558a484d2" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:13:46 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-56877eaa-de2b-45d5-9e7d-dc73d607fc27 tempest-VolumesListAdminTestJSON-2073423714 None] Lock "cinder-quobyte-9e1cf4bc-3403-4f42-ab51-e8f558a484d2" acquired by "delete_volume" :: waited 0.041s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:13:46 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b5ce5c-9f5a-4c98-92f8-d6e87d8c6d42]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:13:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-56877eaa-de2b-45d5-9e7d-dc73d607fc27 tempest-VolumesListAdminTestJSON-2073423714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9e1cf4bc-3403-4f42-ab51-e8f558a484d2 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:46 devstack sudo[100454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9e1cf4bc-3403-4f42-ab51-e8f558a484d2
Jul 03 13:13:46 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:47 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-56877eaa-de2b-45d5-9e7d-dc73d607fc27 tempest-VolumesListAdminTestJSON-2073423714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9e1cf4bc-3403-4f42-ab51-e8f558a484d2" returned: 0 in 1.007s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-56877eaa-de2b-45d5-9e7d-dc73d607fc27 tempest-VolumesListAdminTestJSON-2073423714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9e1cf4bc-3403-4f42-ab51-e8f558a484d2 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:47 devstack sudo[100462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9e1cf4bc-3403-4f42-ab51-e8f558a484d2
Jul 03 13:13:47 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:47 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-56877eaa-de2b-45d5-9e7d-dc73d607fc27 tempest-VolumesListAdminTestJSON-2073423714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9e1cf4bc-3403-4f42-ab51-e8f558a484d2" returned: 0 in 0.808s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:48 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-56877eaa-de2b-45d5-9e7d-dc73d607fc27 tempest-VolumesListAdminTestJSON-2073423714 None] Lock "cinder-quobyte-9e1cf4bc-3403-4f42-ab51-e8f558a484d2" released by "delete_volume" :: held 1.896s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:13:48 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-56877eaa-de2b-45d5-9e7d-dc73d607fc27 tempest-VolumesListAdminTestJSON-2073423714 None] Created reservations ['c0a54db1-f854-4632-9ebb-590e22cd5a33', '9fb44185-a641-4ce5-b007-0d214d1ae6cc', '3230318a-fb47-496d-8b8b-e4cfda18413b', '500e92f5-6d87-4650-b249-93ce7675767f'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:13:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-56877eaa-de2b-45d5-9e7d-dc73d607fc27 tempest-VolumesListAdminTestJSON-2073423714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-56877eaa-de2b-45d5-9e7d-dc73d607fc27 tempest-VolumesListAdminTestJSON-2073423714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:48 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-56877eaa-de2b-45d5-9e7d-dc73d607fc27 tempest-VolumesListAdminTestJSON-2073423714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:48 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-56877eaa-de2b-45d5-9e7d-dc73d607fc27 tempest-VolumesListAdminTestJSON-2073423714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-56877eaa-de2b-45d5-9e7d-dc73d607fc27 tempest-VolumesListAdminTestJSON-2073423714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-56877eaa-de2b-45d5-9e7d-dc73d607fc27 tempest-VolumesListAdminTestJSON-2073423714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:48 devstack sudo[100465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:13:48 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:48 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-eb25076d-0d02-4bec-b028-e5e20153a443 tempest-VolumesListAdminTestJSON-2073423714 None] Acquiring lock "cinder-04fed405-d5f3-4753-9730-10f095e559ab-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:13:48 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-eb25076d-0d02-4bec-b028-e5e20153a443 tempest-VolumesListAdminTestJSON-2073423714 None] Lock "cinder-04fed405-d5f3-4753-9730-10f095e559ab-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:13:48 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-eb25076d-0d02-4bec-b028-e5e20153a443 tempest-VolumesListAdminTestJSON-2073423714 None] Acquiring lock "cinder-quobyte-04fed405-d5f3-4753-9730-10f095e559ab" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:13:48 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-eb25076d-0d02-4bec-b028-e5e20153a443 tempest-VolumesListAdminTestJSON-2073423714 None] Lock "cinder-quobyte-04fed405-d5f3-4753-9730-10f095e559ab" acquired by "delete_volume" :: waited 0.018s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:13:48 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa3b585-78c2-4ad7-8646-e5a3cbac3783]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:13:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-eb25076d-0d02-4bec-b028-e5e20153a443 tempest-VolumesListAdminTestJSON-2073423714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-04fed405-d5f3-4753-9730-10f095e559ab {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:48 devstack sudo[100467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-04fed405-d5f3-4753-9730-10f095e559ab
Jul 03 13:13:48 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:49 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-56877eaa-de2b-45d5-9e7d-dc73d607fc27 tempest-VolumesListAdminTestJSON-2073423714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.917s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:49 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-56877eaa-de2b-45d5-9e7d-dc73d607fc27 tempest-VolumesListAdminTestJSON-2073423714 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:13:49 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-56877eaa-de2b-45d5-9e7d-dc73d607fc27 tempest-VolumesListAdminTestJSON-2073423714 None] Deleted volume successfully.
Jul 03 13:13:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-56877eaa-de2b-45d5-9e7d-dc73d607fc27 tempest-VolumesListAdminTestJSON-2073423714 None] Lock "cinder-9e1cf4bc-3403-4f42-ab51-e8f558a484d2-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:13:49 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-eb25076d-0d02-4bec-b028-e5e20153a443 tempest-VolumesListAdminTestJSON-2073423714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-04fed405-d5f3-4753-9730-10f095e559ab" returned: 0 in 1.120s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-eb25076d-0d02-4bec-b028-e5e20153a443 tempest-VolumesListAdminTestJSON-2073423714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-04fed405-d5f3-4753-9730-10f095e559ab {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:49 devstack sudo[100473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-04fed405-d5f3-4753-9730-10f095e559ab
Jul 03 13:13:49 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:50 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-eb25076d-0d02-4bec-b028-e5e20153a443 tempest-VolumesListAdminTestJSON-2073423714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-04fed405-d5f3-4753-9730-10f095e559ab" returned: 0 in 0.693s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-eb25076d-0d02-4bec-b028-e5e20153a443 tempest-VolumesListAdminTestJSON-2073423714 None] Lock "cinder-quobyte-04fed405-d5f3-4753-9730-10f095e559ab" released by "delete_volume" :: held 1.886s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:13:50 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-eb25076d-0d02-4bec-b028-e5e20153a443 tempest-VolumesListAdminTestJSON-2073423714 None] Created reservations ['fdbfa36b-2e2f-46f1-9d85-4c54ea039ed8', '58b90c4e-7e63-49d8-b041-617140139478', '4894e15a-0986-4294-97c2-9155fa200c9c', 'a333c025-e855-41dd-a8b8-9446c7e8dffd'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:13:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-eb25076d-0d02-4bec-b028-e5e20153a443 tempest-VolumesListAdminTestJSON-2073423714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-eb25076d-0d02-4bec-b028-e5e20153a443 tempest-VolumesListAdminTestJSON-2073423714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:50 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-eb25076d-0d02-4bec-b028-e5e20153a443 tempest-VolumesListAdminTestJSON-2073423714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:50 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-eb25076d-0d02-4bec-b028-e5e20153a443 tempest-VolumesListAdminTestJSON-2073423714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-eb25076d-0d02-4bec-b028-e5e20153a443 tempest-VolumesListAdminTestJSON-2073423714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-eb25076d-0d02-4bec-b028-e5e20153a443 tempest-VolumesListAdminTestJSON-2073423714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:50 devstack sudo[100476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:13:50 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:51 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-eb25076d-0d02-4bec-b028-e5e20153a443 tempest-VolumesListAdminTestJSON-2073423714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.795s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:51 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-eb25076d-0d02-4bec-b028-e5e20153a443 tempest-VolumesListAdminTestJSON-2073423714 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:13:51 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-eb25076d-0d02-4bec-b028-e5e20153a443 tempest-VolumesListAdminTestJSON-2073423714 None] Deleted volume successfully.
Jul 03 13:13:51 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-eb25076d-0d02-4bec-b028-e5e20153a443 tempest-VolumesListAdminTestJSON-2073423714 None] Lock "cinder-04fed405-d5f3-4753-9730-10f095e559ab-delete_volume" released by "delete_volume" :: held 3.016s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:13:56 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:13:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Flow 'volume_create_manager' (7f01faea-676d-41cf-9573-76bd34517206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4154c886-550a-4175-bd09-0d257663b070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4154c886-550a-4175-bd09-0d257663b070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1424085121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1188f3ad-6539-47c1-9626-04116ec267ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ce8989f56cc4fcbbd533dbe63d7067e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:56Z,use_quota=True,user_id='f4fba90d3c574dc2b773f1d6a4251d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aedb88a-f8b2-4118-b4d9-494950519f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aedb88a-f8b2-4118-b4d9-494950519f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a439f9-1da1-4f8d-aa53-5fdd100097a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a439f9-1da1-4f8d-aa53-5fdd100097a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1188f3ad-6539-47c1-9626-04116ec267ce', 'volume_name': 'volume-1188f3ad-6539-47c1-9626-04116ec267ce', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36fcb35e-c229-4b5a-b657-cecda22a0317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36fcb35e-c229-4b5a-b657-cecda22a0317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3adbf0b1-ea11-4ce2-826b-5b193be6e91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:56 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Volume 1188f3ad-6539-47c1-9626-04116ec267ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1188f3ad-6539-47c1-9626-04116ec267ce', 'volume_size': 1}
Jul 03 13:13:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1424085121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1188f3ad-6539-47c1-9626-04116ec267ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ce8989f56cc4fcbbd533dbe63d7067e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:13:56Z,use_quota=True,user_id='f4fba90d3c574dc2b773f1d6a4251d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:13:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Creating volume 1188f3ad-6539-47c1-9626-04116ec267ce {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:13:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:13:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:13:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:13:56 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:13:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:56 devstack sudo[100549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce 1073741824
Jul 03 13:13:56 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:57 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce 1073741824" returned: 0 in 1.472s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:13:57 devstack sudo[100619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce
Jul 03 13:13:57 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:13:58 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root
Jul 03 13:13:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce" returned: 0 in 0.914s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:13:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] <== create_volume: return (2441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:13:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.444s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:13:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3adbf0b1-ea11-4ce2-826b-5b193be6e91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1188f3ad-6539-47c1-9626-04116ec267ce', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b59c659-5e65-4c56-96c2-77721aa55e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:13:58 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Volume volume-1188f3ad-6539-47c1-9626-04116ec267ce (1188f3ad-6539-47c1-9626-04116ec267ce): created successfully
Jul 03 13:13:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b59c659-5e65-4c56-96c2-77721aa55e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:13:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Flow 'volume_create_manager' (7f01faea-676d-41cf-9573-76bd34517206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:13:58 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-4c1d78d2-e9b2-4f51-9d4c-45b67601cb56 tempest-SnapshotMetadataTestJSON-37575975 None] Created volume successfully.
Jul 03 13:13:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4abdff0c-1808-4395-8860-8d68a00cff30 tempest-SnapshotMetadataTestJSON-37575975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:13:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4abdff0c-1808-4395-8860-8d68a00cff30 tempest-SnapshotMetadataTestJSON-37575975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:13:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-4abdff0c-1808-4395-8860-8d68a00cff30 tempest-SnapshotMetadataTestJSON-37575975 None] Creating offline snapshot e702f9bb-1c0e-447d-b473-94c9641d7734 of volume 1188f3ad-6539-47c1-9626-04116ec267ce {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:13:59 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3b17c4-ea64-4708-8449-b304103824b4]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:13:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4abdff0c-1808-4395-8860-8d68a00cff30 tempest-SnapshotMetadataTestJSON-37575975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:00 devstack sudo[100626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce
Jul 03 13:14:00 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:01 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4abdff0c-1808-4395-8860-8d68a00cff30 tempest-SnapshotMetadataTestJSON-37575975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce" returned: 0 in 1.245s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4abdff0c-1808-4395-8860-8d68a00cff30 tempest-SnapshotMetadataTestJSON-37575975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce.e702f9bb-1c0e-447d-b473-94c9641d7734 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:01 devstack sudo[100633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce.e702f9bb-1c0e-447d-b473-94c9641d7734 1G
Jul 03 13:14:01 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:02 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4abdff0c-1808-4395-8860-8d68a00cff30 tempest-SnapshotMetadataTestJSON-37575975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce.e702f9bb-1c0e-447d-b473-94c9641d7734 1G" returned: 0 in 1.572s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4abdff0c-1808-4395-8860-8d68a00cff30 tempest-SnapshotMetadataTestJSON-37575975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1188f3ad-6539-47c1-9626-04116ec267ce -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce.e702f9bb-1c0e-447d-b473-94c9641d7734 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:02 devstack sudo[100638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1188f3ad-6539-47c1-9626-04116ec267ce -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce.e702f9bb-1c0e-447d-b473-94c9641d7734
Jul 03 13:14:02 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:03 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4abdff0c-1808-4395-8860-8d68a00cff30 tempest-SnapshotMetadataTestJSON-37575975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1188f3ad-6539-47c1-9626-04116ec267ce -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce.e702f9bb-1c0e-447d-b473-94c9641d7734" returned: 0 in 0.923s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:03 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-4abdff0c-1808-4395-8860-8d68a00cff30 tempest-SnapshotMetadataTestJSON-37575975 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce.e702f9bb-1c0e-447d-b473-94c9641d7734 is being set with open permissions: ugo+rw
Jul 03 13:14:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4abdff0c-1808-4395-8860-8d68a00cff30 tempest-SnapshotMetadataTestJSON-37575975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce.e702f9bb-1c0e-447d-b473-94c9641d7734 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:03 devstack sudo[100644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce.e702f9bb-1c0e-447d-b473-94c9641d7734
Jul 03 13:14:03 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:04 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4abdff0c-1808-4395-8860-8d68a00cff30 tempest-SnapshotMetadataTestJSON-37575975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce.e702f9bb-1c0e-447d-b473-94c9641d7734" returned: 0 in 0.833s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4abdff0c-1808-4395-8860-8d68a00cff30 tempest-SnapshotMetadataTestJSON-37575975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:04 devstack sudo[100647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce.info
Jul 03 13:14:04 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:05 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4abdff0c-1808-4395-8860-8d68a00cff30 tempest-SnapshotMetadataTestJSON-37575975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce.info" returned: 0 in 0.705s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:05 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-4abdff0c-1808-4395-8860-8d68a00cff30 tempest-SnapshotMetadataTestJSON-37575975 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce.info is being set with open permissions: ugo+rw
Jul 03 13:14:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4abdff0c-1808-4395-8860-8d68a00cff30 tempest-SnapshotMetadataTestJSON-37575975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:05 devstack sudo[100650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce.info
Jul 03 13:14:05 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:06 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4abdff0c-1808-4395-8860-8d68a00cff30 tempest-SnapshotMetadataTestJSON-37575975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce.info" returned: 0 in 0.836s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4abdff0c-1808-4395-8860-8d68a00cff30 tempest-SnapshotMetadataTestJSON-37575975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.278s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:06 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-4abdff0c-1808-4395-8860-8d68a00cff30 tempest-SnapshotMetadataTestJSON-37575975 None] Create snapshot completed successfully
Jul 03 13:14:06 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:14:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Flow 'volume_create_manager' (6b265c9b-0e90-44fb-9bb0-6d38df6feb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b149cadd-e6a3-48f7-8f8d-bc0e2d0d0f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b149cadd-e6a3-48f7-8f8d-bc0e2d0d0f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1740893935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a48610e8-fc44-472b-834a-d2e155b6be08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='370713f6bb434074a10542ac7492d455',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:07Z,use_quota=True,user_id='0ef2676edb8e4af2896cefb56d3ce3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5393c3-db8d-472f-b072-6463051eab8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5393c3-db8d-472f-b072-6463051eab8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351d0072-45ce-4dbc-91ce-5a54d2fe26b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351d0072-45ce-4dbc-91ce-5a54d2fe26b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a48610e8-fc44-472b-834a-d2e155b6be08', 'volume_name': 'volume-a48610e8-fc44-472b-834a-d2e155b6be08', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fadac63-674f-48aa-9d5a-f09fecdc2ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fadac63-674f-48aa-9d5a-f09fecdc2ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (776366a8-62fc-4506-a3b1-4447ed462add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:06 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Volume a48610e8-fc44-472b-834a-d2e155b6be08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a48610e8-fc44-472b-834a-d2e155b6be08', 'volume_size': 1}
Jul 03 13:14:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1740893935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a48610e8-fc44-472b-834a-d2e155b6be08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='370713f6bb434074a10542ac7492d455',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:07Z,use_quota=True,user_id='0ef2676edb8e4af2896cefb56d3ce3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:14:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Creating volume a48610e8-fc44-472b-834a-d2e155b6be08 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:14:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:14:06 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:14:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:06 devstack sudo[100653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08 1073741824
Jul 03 13:14:06 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:07 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08 1073741824" returned: 0 in 0.983s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:07 devstack sudo[100659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08
Jul 03 13:14:07 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9688230b-5d35-4315-8c96-32fe5b74b367 tempest-SnapshotMetadataTestJSON-37575975 None] Acquiring lock "cinder-e702f9bb-1c0e-447d-b473-94c9641d7734-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9688230b-5d35-4315-8c96-32fe5b74b367 tempest-SnapshotMetadataTestJSON-37575975 None] Lock "cinder-e702f9bb-1c0e-447d-b473-94c9641d7734-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9688230b-5d35-4315-8c96-32fe5b74b367 tempest-SnapshotMetadataTestJSON-37575975 None] Acquiring lock "cinder-quobyte-1188f3ad-6539-47c1-9626-04116ec267ce" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9688230b-5d35-4315-8c96-32fe5b74b367 tempest-SnapshotMetadataTestJSON-37575975 None] Lock "cinder-quobyte-1188f3ad-6539-47c1-9626-04116ec267ce" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9688230b-5d35-4315-8c96-32fe5b74b367 tempest-SnapshotMetadataTestJSON-37575975 None] Acquiring lock "cinder-quobyte-e702f9bb-1c0e-447d-b473-94c9641d7734" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9688230b-5d35-4315-8c96-32fe5b74b367 tempest-SnapshotMetadataTestJSON-37575975 None] Lock "cinder-quobyte-e702f9bb-1c0e-447d-b473-94c9641d7734" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-9688230b-5d35-4315-8c96-32fe5b74b367 tempest-SnapshotMetadataTestJSON-37575975 None] Deleting offline snapshot e702f9bb-1c0e-447d-b473-94c9641d7734 of volume 1188f3ad-6539-47c1-9626-04116ec267ce {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:14:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-9688230b-5d35-4315-8c96-32fe5b74b367 tempest-SnapshotMetadataTestJSON-37575975 None] snapshot_file for this snap is: volume-1188f3ad-6539-47c1-9626-04116ec267ce.e702f9bb-1c0e-447d-b473-94c9641d7734 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:14:08 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a985bebc-601e-4d08-8641-042d61476724]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9688230b-5d35-4315-8c96-32fe5b74b367 tempest-SnapshotMetadataTestJSON-37575975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce.e702f9bb-1c0e-447d-b473-94c9641d7734 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:08 devstack sudo[100661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce.e702f9bb-1c0e-447d-b473-94c9641d7734
Jul 03 13:14:08 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:08 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08" returned: 0 in 0.777s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:14:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (776366a8-62fc-4506-a3b1-4447ed462add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a48610e8-fc44-472b-834a-d2e155b6be08', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42942d2f-a121-4afb-acbf-3cb22242e804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:08 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Volume volume-a48610e8-fc44-472b-834a-d2e155b6be08 (a48610e8-fc44-472b-834a-d2e155b6be08): created successfully
Jul 03 13:14:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42942d2f-a121-4afb-acbf-3cb22242e804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Flow 'volume_create_manager' (6b265c9b-0e90-44fb-9bb0-6d38df6feb5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:08 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-a2c19f66-9b11-488b-82bc-dbea389b605c tempest-VolumesActionsTest-1233072926 None] Created volume successfully.
Jul 03 13:14:09 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9688230b-5d35-4315-8c96-32fe5b74b367 tempest-SnapshotMetadataTestJSON-37575975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce.e702f9bb-1c0e-447d-b473-94c9641d7734" returned: 0 in 0.867s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-9688230b-5d35-4315-8c96-32fe5b74b367 tempest-SnapshotMetadataTestJSON-37575975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1188f3ad-6539-47c1-9626-04116ec267ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:14:09 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[067a423e-70b9-4e78-ae71-0f536ecdf2ff]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9688230b-5d35-4315-8c96-32fe5b74b367 tempest-SnapshotMetadataTestJSON-37575975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:09 devstack sudo[100668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce
Jul 03 13:14:09 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:09 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9688230b-5d35-4315-8c96-32fe5b74b367 tempest-SnapshotMetadataTestJSON-37575975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce" returned: 0 in 0.773s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9688230b-5d35-4315-8c96-32fe5b74b367 tempest-SnapshotMetadataTestJSON-37575975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce.e702f9bb-1c0e-447d-b473-94c9641d7734 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:09 devstack sudo[100673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce.e702f9bb-1c0e-447d-b473-94c9641d7734
Jul 03 13:14:09 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:10 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9688230b-5d35-4315-8c96-32fe5b74b367 tempest-SnapshotMetadataTestJSON-37575975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce.e702f9bb-1c0e-447d-b473-94c9641d7734" returned: 0 in 0.999s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9688230b-5d35-4315-8c96-32fe5b74b367 tempest-SnapshotMetadataTestJSON-37575975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce.e702f9bb-1c0e-447d-b473-94c9641d7734 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:10 devstack sudo[100682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce.e702f9bb-1c0e-447d-b473-94c9641d7734
Jul 03 13:14:10 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:11 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9688230b-5d35-4315-8c96-32fe5b74b367 tempest-SnapshotMetadataTestJSON-37575975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce.e702f9bb-1c0e-447d-b473-94c9641d7734" returned: 0 in 0.760s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:11 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9688230b-5d35-4315-8c96-32fe5b74b367 tempest-SnapshotMetadataTestJSON-37575975 None] Lock "cinder-quobyte-e702f9bb-1c0e-447d-b473-94c9641d7734" released by "_delete_snapshot" :: held 3.530s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:11 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9688230b-5d35-4315-8c96-32fe5b74b367 tempest-SnapshotMetadataTestJSON-37575975 None] Lock "cinder-quobyte-1188f3ad-6539-47c1-9626-04116ec267ce" released by "delete_snapshot" :: held 3.568s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:11 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-9688230b-5d35-4315-8c96-32fe5b74b367 tempest-SnapshotMetadataTestJSON-37575975 None] Created reservations ['0330f69c-db40-4d7c-a4e8-157019046bb8', 'b524a252-7322-4af2-b59a-ca44d221cae9', '5d4857c5-edf6-4b2c-aa84-c51bc7cca13b', 'a006bb20-7e23-4e6a-b9a1-cd0131a21a72'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:14:11 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-9688230b-5d35-4315-8c96-32fe5b74b367 tempest-SnapshotMetadataTestJSON-37575975 None] Delete snapshot completed successfully.
Jul 03 13:14:11 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9688230b-5d35-4315-8c96-32fe5b74b367 tempest-SnapshotMetadataTestJSON-37575975 None] Lock "cinder-e702f9bb-1c0e-447d-b473-94c9641d7734-delete_snapshot" released by "delete_snapshot" :: held 3.757s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5f38dc42-2fa8-48fe-81d1-763f92ec7584 tempest-SnapshotMetadataTestJSON-37575975 None] Acquiring lock "cinder-1188f3ad-6539-47c1-9626-04116ec267ce-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5f38dc42-2fa8-48fe-81d1-763f92ec7584 tempest-SnapshotMetadataTestJSON-37575975 None] Lock "cinder-1188f3ad-6539-47c1-9626-04116ec267ce-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5f38dc42-2fa8-48fe-81d1-763f92ec7584 tempest-SnapshotMetadataTestJSON-37575975 None] Acquiring lock "cinder-quobyte-1188f3ad-6539-47c1-9626-04116ec267ce" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5f38dc42-2fa8-48fe-81d1-763f92ec7584 tempest-SnapshotMetadataTestJSON-37575975 None] Lock "cinder-quobyte-1188f3ad-6539-47c1-9626-04116ec267ce" acquired by "delete_volume" :: waited 0.015s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:12 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20279a1-39d4-431b-964d-ebc143c7f1e2]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5f38dc42-2fa8-48fe-81d1-763f92ec7584 tempest-SnapshotMetadataTestJSON-37575975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:12 devstack sudo[100688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce
Jul 03 13:14:12 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:13 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5f38dc42-2fa8-48fe-81d1-763f92ec7584 tempest-SnapshotMetadataTestJSON-37575975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce" returned: 0 in 0.788s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5f38dc42-2fa8-48fe-81d1-763f92ec7584 tempest-SnapshotMetadataTestJSON-37575975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:13 devstack sudo[100694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce
Jul 03 13:14:13 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:14 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5f38dc42-2fa8-48fe-81d1-763f92ec7584 tempest-SnapshotMetadataTestJSON-37575975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-1188f3ad-6539-47c1-9626-04116ec267ce" returned: 0 in 0.750s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5f38dc42-2fa8-48fe-81d1-763f92ec7584 tempest-SnapshotMetadataTestJSON-37575975 None] Lock "cinder-quobyte-1188f3ad-6539-47c1-9626-04116ec267ce" released by "delete_volume" :: held 1.611s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:14 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-5f38dc42-2fa8-48fe-81d1-763f92ec7584 tempest-SnapshotMetadataTestJSON-37575975 None] Created reservations ['79715335-2e7c-4f1d-b7ad-23f38ababf2a', 'd84dd2da-937d-4e61-9a29-530929b668ac', '7af46adf-c8e2-4ace-ad50-c7f8983704b7', '49e611ca-7450-454f-8062-2cac3ce00921'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:14:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5f38dc42-2fa8-48fe-81d1-763f92ec7584 tempest-SnapshotMetadataTestJSON-37575975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5f38dc42-2fa8-48fe-81d1-763f92ec7584 tempest-SnapshotMetadataTestJSON-37575975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5f38dc42-2fa8-48fe-81d1-763f92ec7584 tempest-SnapshotMetadataTestJSON-37575975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5f38dc42-2fa8-48fe-81d1-763f92ec7584 tempest-SnapshotMetadataTestJSON-37575975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5f38dc42-2fa8-48fe-81d1-763f92ec7584 tempest-SnapshotMetadataTestJSON-37575975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5f38dc42-2fa8-48fe-81d1-763f92ec7584 tempest-SnapshotMetadataTestJSON-37575975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:14 devstack sudo[100698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:14:14 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:14:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:15 devstack sudo[100700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:14:15 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:15 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5f38dc42-2fa8-48fe-81d1-763f92ec7584 tempest-SnapshotMetadataTestJSON-37575975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.774s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:15 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-5f38dc42-2fa8-48fe-81d1-763f92ec7584 tempest-SnapshotMetadataTestJSON-37575975 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:14:15 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-5f38dc42-2fa8-48fe-81d1-763f92ec7584 tempest-SnapshotMetadataTestJSON-37575975 None] Deleted volume successfully.
Jul 03 13:14:15 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5f38dc42-2fa8-48fe-81d1-763f92ec7584 tempest-SnapshotMetadataTestJSON-37575975 None] Lock "cinder-1188f3ad-6539-47c1-9626-04116ec267ce-delete_volume" released by "delete_volume" :: held 2.678s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:16 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.045s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:16 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:14:16 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:14:16 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 28 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:14:16 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>, <Thread(tpool_thread_0, started daemon 134850092431040)>, <Thread(tpool_thread_1, started daemon 134850084021952)>, <Thread(tpool_thread_2, started daemon 134850075612864)>, <Thread(tpool_thread_3, started daemon 134850067203776)>, <Thread(tpool_thread_4, started daemon 134850058794688)>, <Thread(tpool_thread_5, started daemon 134850050385600)>, <Thread(tpool_thread_6, started daemon 134850041976512)>, <Thread(tpool_thread_7, started daemon 134850033567424)>, <Thread(tpool_thread_8, started daemon 134850025158336)>, <Thread(tpool_thread_9, started daemon 134850016749248)>, <Thread(tpool_thread_10, started daemon 134850008340160)>, <Thread(tpool_thread_11, started daemon 134849999931072)>, <Thread(tpool_thread_12, started daemon 134849991521984)>, <Thread(tpool_thread_13, started daemon 134849983112896)>, <Thread(tpool_thread_14, started daemon 134849974703808)>, <Thread(tpool_thread_15, started daemon 134849966294720)>, <Thread(tpool_thread_16, started daemon 134849957885632)>, <Thread(tpool_thread_17, started daemon 134849949476544)>, <Thread(tpool_thread_18, started daemon 134849941067456)>, <Thread(tpool_thread_19, started daemon 134849932658368)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:14:21 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:UPDATE=99,cinder:SELECT=69,cinder:DELETE=10,cinder:INSERT=15 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:14:21 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:14:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Flow 'volume_create_manager' (c2bfa2a0-f140-4cb9-86e3-3b01723cf2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8202e2cc-fab5-4688-aaee-6b42a07f9ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:21 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=69,cinder:INSERT=27,cinder:UPDATE=85,cinder:DELETE=7 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:14:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8202e2cc-fab5-4688-aaee-6b42a07f9ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1511533311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5220e733-54f8-490a-b649-8aed7a2f6055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aaa28f8548c468cb3e67680f7c277be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:22Z,use_quota=True,user_id='6205a30a32ce4a898d95f447a0bc8af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13ab4882-50a8-4a25-91ff-148095f74ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13ab4882-50a8-4a25-91ff-148095f74ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba9d5d28-8af8-4dd2-ac2e-48114a760140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:21 devstack cinder-volume[86837]: DEBUG cinder.image.glance [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Creating Keystone auth plugin from conf {{(pid=86837) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 13:14:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba9d5d28-8af8-4dd2-ac2e-48114a760140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5220e733-54f8-490a-b649-8aed7a2f6055', 'volume_name': 'volume-5220e733-54f8-490a-b649-8aed7a2f6055', 'volume_size': 1, 'image_id': '6205b5bb-0e52-4074-98de-35ab3e76638b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6205b5bb-0e52-4074-98de-35ab3e76638b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c125c5701081483fb4d62cc48d112711', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6205b5bb-0e52-4074-98de-35ab3e76638b', 'created_at': datetime.datetime(2026, 7, 3, 10, 50, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 50, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6205b5bb-0e52-4074-98de-35ab3e76638b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7aa53c07f560>}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b931f37b-a6fa-461c-af68-c0f7e5006387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b931f37b-a6fa-461c-af68-c0f7e5006387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64eeb7e8-625d-44f8-8c1a-4b6d7a862fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:22 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Volume 5220e733-54f8-490a-b649-8aed7a2f6055: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5220e733-54f8-490a-b649-8aed7a2f6055', 'volume_size': 1, 'image_id': '6205b5bb-0e52-4074-98de-35ab3e76638b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6205b5bb-0e52-4074-98de-35ab3e76638b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c125c5701081483fb4d62cc48d112711', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6205b5bb-0e52-4074-98de-35ab3e76638b', 'created_at': datetime.datetime(2026, 7, 3, 10, 50, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 50, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6205b5bb-0e52-4074-98de-35ab3e76638b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7aa53c07f560>}
Jul 03 13:14:22 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Trying to clone 5220e733-54f8-490a-b649-8aed7a2f6055 from image 6205b5bb-0e52-4074-98de-35ab3e76638b at location (None, [{'url': 'file:///opt/stack/data/glance/images/6205b5bb-0e52-4074-98de-35ab3e76638b', 'metadata': {}}]). {{(pid=86837) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 03 13:14:22 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_c6vyuijqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86837) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 03 13:14:22 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Image download 20.69 MB at 20.69 MB/s
Jul 03 13:14:22 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f6361d-d6b8-4eee-9b1e-fc0ebf476ac8]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_c6vyuijqdevstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:22 devstack sudo[100786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_c6vyuijqdevstack@QuobyteHD
Jul 03 13:14:22 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:23 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_c6vyuijqdevstack@QuobyteHD" returned: 0 in 1.285s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:23 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Temporary image 6205b5bb-0e52-4074-98de-35ab3e76638b is fetched for user 6205a30a32ce4a898d95f447a0bc8af3. {{(pid=86837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 03 13:14:24 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75def59-fadc-403f-92f8-16b6fa639035]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_c6vyuijqdevstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:24 devstack sudo[100844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_c6vyuijqdevstack@QuobyteHD
Jul 03 13:14:24 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:25 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_c6vyuijqdevstack@QuobyteHD" returned: 0 in 1.099s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1511533311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5220e733-54f8-490a-b649-8aed7a2f6055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aaa28f8548c468cb3e67680f7c277be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:22Z,use_quota=True,user_id='6205a30a32ce4a898d95f447a0bc8af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:14:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Creating volume 5220e733-54f8-490a-b649-8aed7a2f6055 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:14:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:14:25 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:14:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:25 devstack sudo[100853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055 1073741824
Jul 03 13:14:25 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:26 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9a7c5cdb-1f30-432b-b95d-c98e069e66fd tempest-VolumesActionsTest-1233072926 None] Acquiring lock "cinder-a48610e8-fc44-472b-834a-d2e155b6be08" by "attach_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:26 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9a7c5cdb-1f30-432b-b95d-c98e069e66fd tempest-VolumesActionsTest-1233072926 None] Lock "cinder-a48610e8-fc44-472b-834a-d2e155b6be08" acquired by "attach_volume" :: waited 0.028s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:26 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-9a7c5cdb-1f30-432b-b95d-c98e069e66fd tempest-VolumesActionsTest-1233072926 None] Attaching volume a48610e8-fc44-472b-834a-d2e155b6be08 to instance 4647382d-c282-4d03-9002-7bbd87f3d90e at mountpoint /dev/vdb on host None.
Jul 03 13:14:26 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-9a7c5cdb-1f30-432b-b95d-c98e069e66fd tempest-VolumesActionsTest-1233072926 None] Attach volume completed successfully.
Jul 03 13:14:26 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9a7c5cdb-1f30-432b-b95d-c98e069e66fd tempest-VolumesActionsTest-1233072926 None] Lock "cinder-a48610e8-fc44-472b-834a-d2e155b6be08" released by "attach_volume" :: held 0.141s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:26 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055 1073741824" returned: 0 in 1.438s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:26 devstack sudo[100860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055
Jul 03 13:14:26 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:27 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b55f054c-5cd8-4247-b8e2-c33ad130aa9c tempest-VolumesActionsTest-1233072926 None] Acquiring lock "cinder-a48610e8-fc44-472b-834a-d2e155b6be08-detach_volume" by "detach_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:27 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b55f054c-5cd8-4247-b8e2-c33ad130aa9c tempest-VolumesActionsTest-1233072926 None] Lock "cinder-a48610e8-fc44-472b-834a-d2e155b6be08-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:27 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-b55f054c-5cd8-4247-b8e2-c33ad130aa9c tempest-VolumesActionsTest-1233072926 None] Detaching volume a48610e8-fc44-472b-834a-d2e155b6be08 from instance 4647382d-c282-4d03-9002-7bbd87f3d90e.
Jul 03 13:14:27 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-b55f054c-5cd8-4247-b8e2-c33ad130aa9c tempest-VolumesActionsTest-1233072926 None] Detach volume completed successfully.
Jul 03 13:14:27 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b55f054c-5cd8-4247-b8e2-c33ad130aa9c tempest-VolumesActionsTest-1233072926 None] Lock "cinder-a48610e8-fc44-472b-834a-d2e155b6be08-detach_volume" released by "detach_volume" :: held 0.103s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:27 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055" returned: 0 in 0.775s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:27 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] <== create_volume: return (2279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:14:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.287s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:27 devstack cinder-volume[86837]: DEBUG cinder.volume.volume_utils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Attempting download of 6205b5bb-0e52-4074-98de-35ab3e76638b ((None, [{'url': 'file:///opt/stack/data/glance/images/6205b5bb-0e52-4074-98de-35ab3e76638b', 'metadata': {}}])) to volume 5220e733-54f8-490a-b649-8aed7a2f6055. {{(pid=86837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 03 13:14:27 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-a48f2575-a766-4890-89b8-af1720e78a9f req-53ae3f73-094e-4fe7-997b-ab2a8b3da72f tempest-TestMinimumBasicScenario-266485820 None] Terminate volume connection completed successfully.
Jul 03 13:14:27 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-a48f2575-a766-4890-89b8-af1720e78a9f req-53ae3f73-094e-4fe7-997b-ab2a8b3da72f tempest-TestMinimumBasicScenario-266485820 None] Deleting attachment f2f94d89-5699-43a8-b7fb-55c2538dc9c4. {{(pid=86837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:14:27 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7a6f4c-48b9-43c5-8557-4796a54cdf01]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6205b5bb-0e52-4074-98de-35ab3e76638b_o4s3fas3 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:27 devstack sudo[100867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6205b5bb-0e52-4074-98de-35ab3e76638b_o4s3fas3
Jul 03 13:14:27 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:28 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6205b5bb-0e52-4074-98de-35ab3e76638b_o4s3fas3" returned: 0 in 0.985s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6205b5bb-0e52-4074-98de-35ab3e76638b_o4s3fas3 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:28 devstack sudo[100871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6205b5bb-0e52-4074-98de-35ab3e76638b_o4s3fas3
Jul 03 13:14:28 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:29 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6205b5bb-0e52-4074-98de-35ab3e76638b_o4s3fas3" returned: 1 in 0.905s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6205b5bb-0e52-4074-98de-35ab3e76638b_o4s3fas3' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:14:29 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7641168-a202-4fab-ac3a-df616d540728]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_c6vyuijqdevstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:29 devstack sudo[100912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_c6vyuijqdevstack@QuobyteHD
Jul 03 13:14:29 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:29 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cb32fc8f-7d3a-4c5d-b74d-4c3cb4543caa tempest-TestMinimumBasicScenario-266485820 None] Acquiring lock "cinder-7726eea3-dc58-4820-bcdc-b03a85565c80-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:29 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cb32fc8f-7d3a-4c5d-b74d-4c3cb4543caa tempest-TestMinimumBasicScenario-266485820 None] Lock "cinder-7726eea3-dc58-4820-bcdc-b03a85565c80-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:29 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cb32fc8f-7d3a-4c5d-b74d-4c3cb4543caa tempest-TestMinimumBasicScenario-266485820 None] Acquiring lock "cinder-quobyte-7726eea3-dc58-4820-bcdc-b03a85565c80" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:29 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cb32fc8f-7d3a-4c5d-b74d-4c3cb4543caa tempest-TestMinimumBasicScenario-266485820 None] Lock "cinder-quobyte-7726eea3-dc58-4820-bcdc-b03a85565c80" acquired by "delete_volume" :: waited 0.016s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:29 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[059f8129-c2c5-48f8-9db1-7de1660305ca]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cb32fc8f-7d3a-4c5d-b74d-4c3cb4543caa tempest-TestMinimumBasicScenario-266485820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7726eea3-dc58-4820-bcdc-b03a85565c80 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:30 devstack sudo[100915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7726eea3-dc58-4820-bcdc-b03a85565c80
Jul 03 13:14:30 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:30 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_c6vyuijqdevstack@QuobyteHD" returned: 0 in 0.991s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:30 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] 6205b5bb-0e52-4074-98de-35ab3e76638b was qcow2, converting to raw {{(pid=86837) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 03 13:14:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_c6vyuijqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:30 devstack sudo[100921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_c6vyuijqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055
Jul 03 13:14:30 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:30 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cb32fc8f-7d3a-4c5d-b74d-4c3cb4543caa tempest-TestMinimumBasicScenario-266485820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7726eea3-dc58-4820-bcdc-b03a85565c80" returned: 0 in 0.912s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cb32fc8f-7d3a-4c5d-b74d-4c3cb4543caa tempest-TestMinimumBasicScenario-266485820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7726eea3-dc58-4820-bcdc-b03a85565c80 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:30 devstack sudo[100928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7726eea3-dc58-4820-bcdc-b03a85565c80
Jul 03 13:14:30 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:31 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cb32fc8f-7d3a-4c5d-b74d-4c3cb4543caa tempest-TestMinimumBasicScenario-266485820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7726eea3-dc58-4820-bcdc-b03a85565c80" returned: 0 in 0.762s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:31 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cb32fc8f-7d3a-4c5d-b74d-4c3cb4543caa tempest-TestMinimumBasicScenario-266485820 None] Lock "cinder-quobyte-7726eea3-dc58-4820-bcdc-b03a85565c80" released by "delete_volume" :: held 1.730s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:31 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-cb32fc8f-7d3a-4c5d-b74d-4c3cb4543caa tempest-TestMinimumBasicScenario-266485820 None] Created reservations ['250f5246-6e01-4f87-b915-9fb3a30992f2', '79f08b7d-2ca1-412d-abd3-649ef9cce96d', '10dba087-5b25-4ccb-83b5-a770f0e62edf', '57280518-a655-4617-a055-eac418728cc3'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:14:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cb32fc8f-7d3a-4c5d-b74d-4c3cb4543caa tempest-TestMinimumBasicScenario-266485820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cb32fc8f-7d3a-4c5d-b74d-4c3cb4543caa tempest-TestMinimumBasicScenario-266485820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-cb32fc8f-7d3a-4c5d-b74d-4c3cb4543caa tempest-TestMinimumBasicScenario-266485820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-cb32fc8f-7d3a-4c5d-b74d-4c3cb4543caa tempest-TestMinimumBasicScenario-266485820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cb32fc8f-7d3a-4c5d-b74d-4c3cb4543caa tempest-TestMinimumBasicScenario-266485820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cb32fc8f-7d3a-4c5d-b74d-4c3cb4543caa tempest-TestMinimumBasicScenario-266485820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:31 devstack sudo[100941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:14:31 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:32 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cb32fc8f-7d3a-4c5d-b74d-4c3cb4543caa tempest-TestMinimumBasicScenario-266485820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.909s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:32 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-cb32fc8f-7d3a-4c5d-b74d-4c3cb4543caa tempest-TestMinimumBasicScenario-266485820 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:14:32 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-cb32fc8f-7d3a-4c5d-b74d-4c3cb4543caa tempest-TestMinimumBasicScenario-266485820 None] Deleted volume successfully.
Jul 03 13:14:32 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cb32fc8f-7d3a-4c5d-b74d-4c3cb4543caa tempest-TestMinimumBasicScenario-266485820 None] Lock "cinder-7726eea3-dc58-4820-bcdc-b03a85565c80-delete_volume" released by "delete_volume" :: held 2.902s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:32 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_c6vyuijqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055" returned: 0 in 2.410s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:32 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_c6vyuijqdevstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055 {{(pid=86837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 13:14:32 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Converted 112.00 MB image at 46.46 MB/s
Jul 03 13:14:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:32 devstack sudo[100945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055 1G
Jul 03 13:14:32 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:33 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055 1G" returned: 0 in 0.951s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:33 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad0b21d-ce4d-4052-956e-e3ac1a8c1898]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:33 devstack sudo[100987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055
Jul 03 13:14:33 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:34 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055" returned: 0 in 0.857s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:34 devstack sudo[100993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055
Jul 03 13:14:34 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:35 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055" returned: 1 in 0.825s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:14:35 devstack cinder-volume[86837]: DEBUG cinder.volume.volume_utils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Downloaded image 6205b5bb-0e52-4074-98de-35ab3e76638b ((None, [{'url': 'file:///opt/stack/data/glance/images/6205b5bb-0e52-4074-98de-35ab3e76638b', 'metadata': {}}])) to volume 5220e733-54f8-490a-b649-8aed7a2f6055 successfully. {{(pid=86837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 03 13:14:35 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Temporary image 6205b5bb-0e52-4074-98de-35ab3e76638b for user 6205a30a32ce4a898d95f447a0bc8af3 is deleted. {{(pid=86837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 03 13:14:35 devstack cinder-volume[86837]: DEBUG cinder.volume.volume_utils [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Marking volume 5220e733-54f8-490a-b649-8aed7a2f6055 as bootable. {{(pid=86837) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 03 13:14:35 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Copying metadata from image 6205b5bb-0e52-4074-98de-35ab3e76638b to 5220e733-54f8-490a-b649-8aed7a2f6055. {{(pid=86837) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 13:14:35 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Creating volume glance metadata for volume 5220e733-54f8-490a-b649-8aed7a2f6055 backed by image 6205b5bb-0e52-4074-98de-35ab3e76638b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6205b5bb-0e52-4074-98de-35ab3e76638b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86837) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 13:14:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64eeb7e8-625d-44f8-8c1a-4b6d7a862fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5220e733-54f8-490a-b649-8aed7a2f6055', 'volume_size': 1, 'image_id': '6205b5bb-0e52-4074-98de-35ab3e76638b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6205b5bb-0e52-4074-98de-35ab3e76638b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c125c5701081483fb4d62cc48d112711', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6205b5bb-0e52-4074-98de-35ab3e76638b', 'created_at': datetime.datetime(2026, 7, 3, 10, 50, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 50, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6205b5bb-0e52-4074-98de-35ab3e76638b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7aa53c07f560>}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606137e6-2110-4a50-8e96-50d4826ca449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:35 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Volume volume-5220e733-54f8-490a-b649-8aed7a2f6055 (5220e733-54f8-490a-b649-8aed7a2f6055): created successfully
Jul 03 13:14:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606137e6-2110-4a50-8e96-50d4826ca449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Flow 'volume_create_manager' (c2bfa2a0-f140-4cb9-86e3-3b01723cf2fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:35 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-d5ef5d92-b862-4737-8a48-c50b5b6d0e24 tempest-VolumesExtendTest-283594505 None] Created volume successfully.
Jul 03 13:14:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-47ae4484-80eb-4040-9bb4-d6e350a396db tempest-VolumesExtendTest-283594505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-47ae4484-80eb-4040-9bb4-d6e350a396db tempest-VolumesExtendTest-283594505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:36 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8f20d6-a969-43b8-858a-93c460847a3a]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-47ae4484-80eb-4040-9bb4-d6e350a396db tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:36 devstack sudo[101002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055
Jul 03 13:14:36 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:36 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-47ae4484-80eb-4040-9bb4-d6e350a396db tempest-VolumesExtendTest-283594505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055" returned: 0 in 0.883s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-47ae4484-80eb-4040-9bb4-d6e350a396db tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:37 devstack sudo[101006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055
Jul 03 13:14:37 devstack sudo[101006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:37 devstack sudo[101006]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-47ae4484-80eb-4040-9bb4-d6e350a396db tempest-VolumesExtendTest-283594505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055" returned: 1 in 0.800s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-47ae4484-80eb-4040-9bb4-d6e350a396db tempest-VolumesExtendTest-283594505 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:14:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-47ae4484-80eb-4040-9bb4-d6e350a396db tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055 2G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-47ae4484-80eb-4040-9bb4-d6e350a396db tempest-VolumesExtendTest-283594505 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055 2G" returned: 0 in 0.056s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-47ae4484-80eb-4040-9bb4-d6e350a396db tempest-VolumesExtendTest-283594505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.787s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:37 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-47ae4484-80eb-4040-9bb4-d6e350a396db tempest-VolumesExtendTest-283594505 None] Extend volume completed successfully.
Jul 03 13:14:38 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9973ade6-4ada-4cad-8650-af96d08e4d2f tempest-VolumesExtendTest-283594505 None] Acquiring lock "cinder-5220e733-54f8-490a-b649-8aed7a2f6055-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:38 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9973ade6-4ada-4cad-8650-af96d08e4d2f tempest-VolumesExtendTest-283594505 None] Lock "cinder-5220e733-54f8-490a-b649-8aed7a2f6055-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:38 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9973ade6-4ada-4cad-8650-af96d08e4d2f tempest-VolumesExtendTest-283594505 None] Acquiring lock "cinder-quobyte-5220e733-54f8-490a-b649-8aed7a2f6055" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:38 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9973ade6-4ada-4cad-8650-af96d08e4d2f tempest-VolumesExtendTest-283594505 None] Lock "cinder-quobyte-5220e733-54f8-490a-b649-8aed7a2f6055" acquired by "delete_volume" :: waited 0.024s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:38 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[743c2942-84a9-4652-89df-77c9cd374555]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9973ade6-4ada-4cad-8650-af96d08e4d2f tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:38 devstack sudo[101014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055
Jul 03 13:14:38 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:39 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9973ade6-4ada-4cad-8650-af96d08e4d2f tempest-VolumesExtendTest-283594505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055" returned: 0 in 0.861s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9973ade6-4ada-4cad-8650-af96d08e4d2f tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:39 devstack sudo[101018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055
Jul 03 13:14:39 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:40 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9973ade6-4ada-4cad-8650-af96d08e4d2f tempest-VolumesExtendTest-283594505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055" returned: 1 in 0.886s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9973ade6-4ada-4cad-8650-af96d08e4d2f tempest-VolumesExtendTest-283594505 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:14:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9973ade6-4ada-4cad-8650-af96d08e4d2f tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:40 devstack sudo[101023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055
Jul 03 13:14:40 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:41 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9973ade6-4ada-4cad-8650-af96d08e4d2f tempest-VolumesExtendTest-283594505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5220e733-54f8-490a-b649-8aed7a2f6055" returned: 0 in 0.768s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:41 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9973ade6-4ada-4cad-8650-af96d08e4d2f tempest-VolumesExtendTest-283594505 None] Lock "cinder-quobyte-5220e733-54f8-490a-b649-8aed7a2f6055" released by "delete_volume" :: held 2.605s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:41 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-9973ade6-4ada-4cad-8650-af96d08e4d2f tempest-VolumesExtendTest-283594505 None] Created reservations ['67364809-0175-48be-bbd2-cfbc78bf496d', '4113a753-d330-4996-bf6d-4af9360085bc', '471fb736-c5a1-4615-95e1-14509cafe91b', '0eff6b43-cae4-48ac-a6b3-4d254b37e323'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:14:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9973ade6-4ada-4cad-8650-af96d08e4d2f tempest-VolumesExtendTest-283594505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9973ade6-4ada-4cad-8650-af96d08e4d2f tempest-VolumesExtendTest-283594505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9973ade6-4ada-4cad-8650-af96d08e4d2f tempest-VolumesExtendTest-283594505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9973ade6-4ada-4cad-8650-af96d08e4d2f tempest-VolumesExtendTest-283594505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9973ade6-4ada-4cad-8650-af96d08e4d2f tempest-VolumesExtendTest-283594505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9973ade6-4ada-4cad-8650-af96d08e4d2f tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:41 devstack sudo[101028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:14:41 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:42 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9973ade6-4ada-4cad-8650-af96d08e4d2f tempest-VolumesExtendTest-283594505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.893s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:42 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-9973ade6-4ada-4cad-8650-af96d08e4d2f tempest-VolumesExtendTest-283594505 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:14:42 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-9973ade6-4ada-4cad-8650-af96d08e4d2f tempest-VolumesExtendTest-283594505 None] Deleted volume successfully.
Jul 03 13:14:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9973ade6-4ada-4cad-8650-af96d08e4d2f tempest-VolumesExtendTest-283594505 None] Lock "cinder-5220e733-54f8-490a-b649-8aed7a2f6055-delete_volume" released by "delete_volume" :: held 3.830s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:42 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:14:42 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Flow 'volume_create_manager' (0e9eb10e-a4cb-4bf2-8e0d-b4961f52ceca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:42 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3cceff5-60fd-4a8d-b491-7ed27f5eff1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:42 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3cceff5-60fd-4a8d-b491-7ed27f5eff1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-113437626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c46872-09bc-4ca0-816d-fe1a68c7716a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aaa28f8548c468cb3e67680f7c277be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:43Z,use_quota=True,user_id='6205a30a32ce4a898d95f447a0bc8af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:42 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae96be41-0f60-400c-a924-12c76371f697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:42 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae96be41-0f60-400c-a924-12c76371f697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:42 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33e422c-0060-4731-b167-1c65178ab360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:42 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33e422c-0060-4731-b167-1c65178ab360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7c46872-09bc-4ca0-816d-fe1a68c7716a', 'volume_name': 'volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:42 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27ae0995-c6c2-4931-93fe-382e6b82b5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:42 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27ae0995-c6c2-4931-93fe-382e6b82b5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:42 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea65e0e-dc59-4f47-a1e4-f08eb8e88caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:42 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Volume f7c46872-09bc-4ca0-816d-fe1a68c7716a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a', 'volume_size': 1}
Jul 03 13:14:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:42 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-113437626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c46872-09bc-4ca0-816d-fe1a68c7716a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aaa28f8548c468cb3e67680f7c277be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:43Z,use_quota=True,user_id='6205a30a32ce4a898d95f447a0bc8af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:14:42 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Creating volume f7c46872-09bc-4ca0-816d-fe1a68c7716a {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:14:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:42 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:42 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:42 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:14:42 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:14:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:42 devstack sudo[101033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a 1073741824
Jul 03 13:14:42 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:44 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a 1073741824" returned: 0 in 1.348s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:44 devstack sudo[101055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a
Jul 03 13:14:44 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:45 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a" returned: 0 in 0.832s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:45 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] <== create_volume: return (2256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:14:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.260s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:45 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea65e0e-dc59-4f47-a1e4-f08eb8e88caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:45 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f35e1aa6-1223-4cf9-8f94-f10f7d84f7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:45 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Volume volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a (f7c46872-09bc-4ca0-816d-fe1a68c7716a): created successfully
Jul 03 13:14:45 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f35e1aa6-1223-4cf9-8f94-f10f7d84f7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:45 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Flow 'volume_create_manager' (0e9eb10e-a4cb-4bf2-8e0d-b4961f52ceca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:45 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-87b3b3fa-f6d7-4ae7-b64f-fa0a706883cc tempest-VolumesExtendTest-283594505 None] Created volume successfully.
Jul 03 13:14:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a6609529-59fd-4e24-afca-b0fefbe7771d tempest-VolumesExtendTest-283594505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a6609529-59fd-4e24-afca-b0fefbe7771d tempest-VolumesExtendTest-283594505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:46 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-a6609529-59fd-4e24-afca-b0fefbe7771d tempest-VolumesExtendTest-283594505 None] Creating offline snapshot 3b73e347-daae-4295-b7a8-24a33dffa77b of volume f7c46872-09bc-4ca0-816d-fe1a68c7716a {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:14:46 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2204e90-adde-4f19-8b28-7465be746b1a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6609529-59fd-4e24-afca-b0fefbe7771d tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:46 devstack sudo[101059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a
Jul 03 13:14:46 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:47 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6609529-59fd-4e24-afca-b0fefbe7771d tempest-VolumesExtendTest-283594505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a" returned: 0 in 0.877s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6609529-59fd-4e24-afca-b0fefbe7771d tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.3b73e347-daae-4295-b7a8-24a33dffa77b 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:47 devstack sudo[101069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.3b73e347-daae-4295-b7a8-24a33dffa77b 1G
Jul 03 13:14:47 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:48 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6609529-59fd-4e24-afca-b0fefbe7771d tempest-VolumesExtendTest-283594505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.3b73e347-daae-4295-b7a8-24a33dffa77b 1G" returned: 0 in 0.938s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6609529-59fd-4e24-afca-b0fefbe7771d tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.3b73e347-daae-4295-b7a8-24a33dffa77b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:48 devstack sudo[101074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.3b73e347-daae-4295-b7a8-24a33dffa77b
Jul 03 13:14:48 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:49 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6609529-59fd-4e24-afca-b0fefbe7771d tempest-VolumesExtendTest-283594505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.3b73e347-daae-4295-b7a8-24a33dffa77b" returned: 0 in 1.304s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:49 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-a6609529-59fd-4e24-afca-b0fefbe7771d tempest-VolumesExtendTest-283594505 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.3b73e347-daae-4295-b7a8-24a33dffa77b is being set with open permissions: ugo+rw
Jul 03 13:14:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6609529-59fd-4e24-afca-b0fefbe7771d tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.3b73e347-daae-4295-b7a8-24a33dffa77b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:49 devstack sudo[101140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.3b73e347-daae-4295-b7a8-24a33dffa77b
Jul 03 13:14:49 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:50 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6609529-59fd-4e24-afca-b0fefbe7771d tempest-VolumesExtendTest-283594505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.3b73e347-daae-4295-b7a8-24a33dffa77b" returned: 0 in 1.196s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6609529-59fd-4e24-afca-b0fefbe7771d tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:50 devstack sudo[101150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.info
Jul 03 13:14:50 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:51 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6609529-59fd-4e24-afca-b0fefbe7771d tempest-VolumesExtendTest-283594505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.info" returned: 0 in 1.090s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:51 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-a6609529-59fd-4e24-afca-b0fefbe7771d tempest-VolumesExtendTest-283594505 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.info is being set with open permissions: ugo+rw
Jul 03 13:14:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6609529-59fd-4e24-afca-b0fefbe7771d tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:51 devstack sudo[101153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.info
Jul 03 13:14:51 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:52 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-14b9102b-0109-42f9-8aec-5017156f7ec9 tempest-VolumesActionsTest-1233072926 None] Acquiring lock "cinder-a48610e8-fc44-472b-834a-d2e155b6be08" by "attach_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:52 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-14b9102b-0109-42f9-8aec-5017156f7ec9 tempest-VolumesActionsTest-1233072926 None] Lock "cinder-a48610e8-fc44-472b-834a-d2e155b6be08" acquired by "attach_volume" :: waited 0.029s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:52 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-14b9102b-0109-42f9-8aec-5017156f7ec9 tempest-VolumesActionsTest-1233072926 None] Attaching volume a48610e8-fc44-472b-834a-d2e155b6be08 to instance 331fb3bd-6757-4819-be32-4ef810a53130 at mountpoint /dev/vdb on host None.
Jul 03 13:14:52 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-14b9102b-0109-42f9-8aec-5017156f7ec9 tempest-VolumesActionsTest-1233072926 None] Attach volume completed successfully.
Jul 03 13:14:52 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-14b9102b-0109-42f9-8aec-5017156f7ec9 tempest-VolumesActionsTest-1233072926 None] Lock "cinder-a48610e8-fc44-472b-834a-d2e155b6be08" released by "attach_volume" :: held 0.146s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:52 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a6609529-59fd-4e24-afca-b0fefbe7771d tempest-VolumesExtendTest-283594505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.info" returned: 0 in 1.061s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a6609529-59fd-4e24-afca-b0fefbe7771d tempest-VolumesExtendTest-283594505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.631s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:52 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-a6609529-59fd-4e24-afca-b0fefbe7771d tempest-VolumesExtendTest-283594505 None] Create snapshot completed successfully
Jul 03 13:14:53 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ffabdfa2-586a-49ec-9789-8df7770a6826 tempest-VolumesActionsTest-1233072926 None] Acquiring lock "cinder-a48610e8-fc44-472b-834a-d2e155b6be08-detach_volume" by "detach_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:53 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ffabdfa2-586a-49ec-9789-8df7770a6826 tempest-VolumesActionsTest-1233072926 None] Lock "cinder-a48610e8-fc44-472b-834a-d2e155b6be08-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:53 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-ffabdfa2-586a-49ec-9789-8df7770a6826 tempest-VolumesActionsTest-1233072926 None] Detaching volume a48610e8-fc44-472b-834a-d2e155b6be08 from instance 331fb3bd-6757-4819-be32-4ef810a53130.
Jul 03 13:14:53 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-ffabdfa2-586a-49ec-9789-8df7770a6826 tempest-VolumesActionsTest-1233072926 None] Detach volume completed successfully.
Jul 03 13:14:53 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ffabdfa2-586a-49ec-9789-8df7770a6826 tempest-VolumesActionsTest-1233072926 None] Lock "cinder-a48610e8-fc44-472b-834a-d2e155b6be08-detach_volume" released by "detach_volume" :: held 0.075s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:14:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1076603b-0433-46ea-8557-c51aa1b0fae1 tempest-VolumesExtendTest-283594505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1076603b-0433-46ea-8557-c51aa1b0fae1 tempest-VolumesExtendTest-283594505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:53 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff19ce18-c984-46ff-ad6c-071a4734a5f6]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1076603b-0433-46ea-8557-c51aa1b0fae1 tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:53 devstack sudo[101157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a
Jul 03 13:14:53 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:54 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:14:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Flow 'volume_create_manager' (e2e67980-7c4a-4440-98e8-b224b06345bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad609da8-96ca-4a9c-8734-a9a04dc92430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad609da8-96ca-4a9c-8734-a9a04dc92430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-8048860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=227cd5bf-01fa-4557-8275-4cd43b28ae7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a527ba5949a4e88b56140db740e7d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:55Z,use_quota=True,user_id='56033c4d812e4ec48bff7cc1b9223eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4be5e04-498d-4396-a2b2-20062d37a23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4be5e04-498d-4396-a2b2-20062d37a23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87333e65-a447-4c67-bf36-32cf6274c134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87333e65-a447-4c67-bf36-32cf6274c134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '227cd5bf-01fa-4557-8275-4cd43b28ae7b', 'volume_name': 'volume-227cd5bf-01fa-4557-8275-4cd43b28ae7b', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49a25bee-a427-4f4d-a50b-cb10c4852587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49a25bee-a427-4f4d-a50b-cb10c4852587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f080c7-baef-4305-8f95-31cdd7739dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:54 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Volume 227cd5bf-01fa-4557-8275-4cd43b28ae7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-227cd5bf-01fa-4557-8275-4cd43b28ae7b', 'volume_size': 1}
Jul 03 13:14:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:54 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1076603b-0433-46ea-8557-c51aa1b0fae1 tempest-VolumesExtendTest-283594505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a" returned: 0 in 1.060s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1076603b-0433-46ea-8557-c51aa1b0fae1 tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.3b73e347-daae-4295-b7a8-24a33dffa77b 2G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1076603b-0433-46ea-8557-c51aa1b0fae1 tempest-VolumesExtendTest-283594505 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.3b73e347-daae-4295-b7a8-24a33dffa77b 2G" returned: 0 in 0.154s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1076603b-0433-46ea-8557-c51aa1b0fae1 tempest-VolumesExtendTest-283594505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.250s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.296s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:54 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-8048860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=227cd5bf-01fa-4557-8275-4cd43b28ae7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a527ba5949a4e88b56140db740e7d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:55Z,use_quota=True,user_id='56033c4d812e4ec48bff7cc1b9223eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:14:54 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Creating volume 227cd5bf-01fa-4557-8275-4cd43b28ae7b {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:14:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:54 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:54 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:54 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:14:54 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:14:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-227cd5bf-01fa-4557-8275-4cd43b28ae7b 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:54 devstack sudo[101166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-227cd5bf-01fa-4557-8275-4cd43b28ae7b 1073741824
Jul 03 13:14:54 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:55 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-1076603b-0433-46ea-8557-c51aa1b0fae1 tempest-VolumesExtendTest-283594505 None] Extend volume completed successfully.
Jul 03 13:14:56 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-227cd5bf-01fa-4557-8275-4cd43b28ae7b 1073741824" returned: 0 in 1.050s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-227cd5bf-01fa-4557-8275-4cd43b28ae7b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:56 devstack sudo[101217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-227cd5bf-01fa-4557-8275-4cd43b28ae7b
Jul 03 13:14:56 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:56 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c1cd3c52-49d1-48d4-b100-f7bf2f6485f2 tempest-VolumesExtendTest-283594505 None] Acquiring lock "cinder-3b73e347-daae-4295-b7a8-24a33dffa77b-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:56 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c1cd3c52-49d1-48d4-b100-f7bf2f6485f2 tempest-VolumesExtendTest-283594505 None] Lock "cinder-3b73e347-daae-4295-b7a8-24a33dffa77b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:56 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c1cd3c52-49d1-48d4-b100-f7bf2f6485f2 tempest-VolumesExtendTest-283594505 None] Acquiring lock "cinder-quobyte-f7c46872-09bc-4ca0-816d-fe1a68c7716a" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:56 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c1cd3c52-49d1-48d4-b100-f7bf2f6485f2 tempest-VolumesExtendTest-283594505 None] Lock "cinder-quobyte-f7c46872-09bc-4ca0-816d-fe1a68c7716a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:56 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c1cd3c52-49d1-48d4-b100-f7bf2f6485f2 tempest-VolumesExtendTest-283594505 None] Acquiring lock "cinder-quobyte-3b73e347-daae-4295-b7a8-24a33dffa77b" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:14:56 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c1cd3c52-49d1-48d4-b100-f7bf2f6485f2 tempest-VolumesExtendTest-283594505 None] Lock "cinder-quobyte-3b73e347-daae-4295-b7a8-24a33dffa77b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:14:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-c1cd3c52-49d1-48d4-b100-f7bf2f6485f2 tempest-VolumesExtendTest-283594505 None] Deleting offline snapshot 3b73e347-daae-4295-b7a8-24a33dffa77b of volume f7c46872-09bc-4ca0-816d-fe1a68c7716a {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:14:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-c1cd3c52-49d1-48d4-b100-f7bf2f6485f2 tempest-VolumesExtendTest-283594505 None] snapshot_file for this snap is: volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.3b73e347-daae-4295-b7a8-24a33dffa77b {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:14:56 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[0816f3f4-1eb9-49cb-a473-b8134d8e157a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c1cd3c52-49d1-48d4-b100-f7bf2f6485f2 tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.3b73e347-daae-4295-b7a8-24a33dffa77b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:56 devstack sudo[101221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.3b73e347-daae-4295-b7a8-24a33dffa77b
Jul 03 13:14:56 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:56 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-227cd5bf-01fa-4557-8275-4cd43b28ae7b" returned: 0 in 0.766s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:14:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f080c7-baef-4305-8f95-31cdd7739dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-227cd5bf-01fa-4557-8275-4cd43b28ae7b', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2559b3d4-022a-4b73-9e87-d163c2cac24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:56 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Volume volume-227cd5bf-01fa-4557-8275-4cd43b28ae7b (227cd5bf-01fa-4557-8275-4cd43b28ae7b): created successfully
Jul 03 13:14:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2559b3d4-022a-4b73-9e87-d163c2cac24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Flow 'volume_create_manager' (e2e67980-7c4a-4440-98e8-b224b06345bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:56 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-b86eb9da-d4f4-4489-84b6-04d0c976d4bb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Created volume successfully.
Jul 03 13:14:57 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c1cd3c52-49d1-48d4-b100-f7bf2f6485f2 tempest-VolumesExtendTest-283594505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.3b73e347-daae-4295-b7a8-24a33dffa77b" returned: 0 in 1.014s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-c1cd3c52-49d1-48d4-b100-f7bf2f6485f2 tempest-VolumesExtendTest-283594505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:14:57 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4aeb7e-b0b5-41de-98e6-d530cc722fa5]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:14:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c1cd3c52-49d1-48d4-b100-f7bf2f6485f2 tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:57 devstack sudo[101229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a
Jul 03 13:14:57 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:58 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c1cd3c52-49d1-48d4-b100-f7bf2f6485f2 tempest-VolumesExtendTest-283594505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a" returned: 0 in 0.830s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c1cd3c52-49d1-48d4-b100-f7bf2f6485f2 tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.3b73e347-daae-4295-b7a8-24a33dffa77b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:58 devstack sudo[101235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.3b73e347-daae-4295-b7a8-24a33dffa77b
Jul 03 13:14:58 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Flow 'volume_create_manager' (bf64dc54-fc75-400a-8b52-1d3f90caecf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14a8f74b-a6e6-4127-a4a0-0d7fc112439c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14a8f74b-a6e6-4127-a4a0-0d7fc112439c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-927009500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02cb75d7-6a4c-44c5-b2af-6d0747687481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a527ba5949a4e88b56140db740e7d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:58Z,use_quota=True,user_id='56033c4d812e4ec48bff7cc1b9223eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6725df2-00e5-409f-a921-4a4659dbc7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6725df2-00e5-409f-a921-4a4659dbc7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3428ab-30c2-4418-b5fd-d00755aaa957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3428ab-30c2-4418-b5fd-d00755aaa957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02cb75d7-6a4c-44c5-b2af-6d0747687481', 'volume_name': 'volume-02cb75d7-6a4c-44c5-b2af-6d0747687481', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6576f907-e948-4f2f-bb13-d39794b2bdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6576f907-e948-4f2f-bb13-d39794b2bdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1537b6a6-b559-4e18-b199-c4136d39bdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:58 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Volume 02cb75d7-6a4c-44c5-b2af-6d0747687481: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02cb75d7-6a4c-44c5-b2af-6d0747687481', 'volume_size': 1}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-927009500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02cb75d7-6a4c-44c5-b2af-6d0747687481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a527ba5949a4e88b56140db740e7d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:58Z,use_quota=True,user_id='56033c4d812e4ec48bff7cc1b9223eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Creating volume 02cb75d7-6a4c-44c5-b2af-6d0747687481 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:14:58 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-02cb75d7-6a4c-44c5-b2af-6d0747687481 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:58 devstack sudo[101237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-02cb75d7-6a4c-44c5-b2af-6d0747687481 1073741824
Jul 03 13:14:58 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Flow 'volume_create_manager' (cd76b7c2-2ac6-4b46-956e-3567e3f5ad96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0457bb7-1dc2-46e0-9ec8-c6afd34590e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0457bb7-1dc2-46e0-9ec8-c6afd34590e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1317334177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e343da-14ae-4658-a902-b8c308c5d9fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a527ba5949a4e88b56140db740e7d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:59Z,use_quota=True,user_id='56033c4d812e4ec48bff7cc1b9223eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea22bd74-08c5-4069-ad95-98ecc0c079b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea22bd74-08c5-4069-ad95-98ecc0c079b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (200b070b-90a1-46f5-8cab-541ddfa4a1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (200b070b-90a1-46f5-8cab-541ddfa4a1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96e343da-14ae-4658-a902-b8c308c5d9fb', 'volume_name': 'volume-96e343da-14ae-4658-a902-b8c308c5d9fb', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f51f158-6c2a-479e-929a-52f45053a3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f51f158-6c2a-479e-929a-52f45053a3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3355c841-983d-47b2-ac56-126a1e3b4e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:58 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Volume 96e343da-14ae-4658-a902-b8c308c5d9fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96e343da-14ae-4658-a902-b8c308c5d9fb', 'volume_size': 1}
Jul 03 13:14:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:59 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c1cd3c52-49d1-48d4-b100-f7bf2f6485f2 tempest-VolumesExtendTest-283594505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.3b73e347-daae-4295-b7a8-24a33dffa77b" returned: 0 in 1.229s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c1cd3c52-49d1-48d4-b100-f7bf2f6485f2 tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.3b73e347-daae-4295-b7a8-24a33dffa77b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:59 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:14:59 devstack sudo[101245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.3b73e347-daae-4295-b7a8-24a33dffa77b
Jul 03 13:14:59 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Flow 'volume_create_manager' (2f345c71-5c8b-4c30-aefc-a1fa6d8aacad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:14:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642a8415-d829-4d43-bf29-2629212d5845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642a8415-d829-4d43-bf29-2629212d5845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1027483181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0b06f6-5bd8-4dc4-a8ef-0540cab60711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a527ba5949a4e88b56140db740e7d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:59Z,use_quota=True,user_id='56033c4d812e4ec48bff7cc1b9223eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c26ec9e-93e2-4dc7-8d98-eacbdbcceecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c26ec9e-93e2-4dc7-8d98-eacbdbcceecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (160f06e6-1a28-4b78-a236-557766fd938e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (160f06e6-1a28-4b78-a236-557766fd938e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af0b06f6-5bd8-4dc4-a8ef-0540cab60711', 'volume_name': 'volume-af0b06f6-5bd8-4dc4-a8ef-0540cab60711', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae771221-8b9d-4d5f-b1c9-280631cb92db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae771221-8b9d-4d5f-b1c9-280631cb92db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:14:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eba5412-8f2c-4991-9ad5-226a117c3529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:14:59 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Volume af0b06f6-5bd8-4dc4-a8ef-0540cab60711: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af0b06f6-5bd8-4dc4-a8ef-0540cab60711', 'volume_size': 1}
Jul 03 13:14:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:14:59 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root
Jul 03 13:14:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-02cb75d7-6a4c-44c5-b2af-6d0747687481 1073741824" returned: 0 in 1.253s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:14:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-02cb75d7-6a4c-44c5-b2af-6d0747687481 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:14:59 devstack sudo[101248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-02cb75d7-6a4c-44c5-b2af-6d0747687481
Jul 03 13:14:59 devstack sudo[101248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:14:59 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Flow 'volume_create_manager' (50491625-7079-470f-ae6c-8840ed67da63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee2aaf8e-364e-428e-bea1-bb6d36682693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee2aaf8e-364e-428e-bea1-bb6d36682693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-883203210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4dcddc5-cefa-4c65-b89a-d1cf451cd354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a527ba5949a4e88b56140db740e7d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:15:00Z,use_quota=True,user_id='56033c4d812e4ec48bff7cc1b9223eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e47e8c97-132e-4149-ac8c-263589387d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e47e8c97-132e-4149-ac8c-263589387d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (158f6f9f-7761-46b6-a628-0756dc844c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (158f6f9f-7761-46b6-a628-0756dc844c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4dcddc5-cefa-4c65-b89a-d1cf451cd354', 'volume_name': 'volume-e4dcddc5-cefa-4c65-b89a-d1cf451cd354', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e66680e-b219-49e8-82e9-2bb7c2c77c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e66680e-b219-49e8-82e9-2bb7c2c77c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9562722b-294e-40fb-b85b-e27aedbb2b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:00 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Volume e4dcddc5-cefa-4c65-b89a-d1cf451cd354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4dcddc5-cefa-4c65-b89a-d1cf451cd354', 'volume_size': 1}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:00 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c1cd3c52-49d1-48d4-b100-f7bf2f6485f2 tempest-VolumesExtendTest-283594505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a.3b73e347-daae-4295-b7a8-24a33dffa77b" returned: 0 in 0.966s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c1cd3c52-49d1-48d4-b100-f7bf2f6485f2 tempest-VolumesExtendTest-283594505 None] Lock "cinder-quobyte-3b73e347-daae-4295-b7a8-24a33dffa77b" released by "_delete_snapshot" :: held 4.155s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c1cd3c52-49d1-48d4-b100-f7bf2f6485f2 tempest-VolumesExtendTest-283594505 None] Lock "cinder-quobyte-f7c46872-09bc-4ca0-816d-fe1a68c7716a" released by "delete_snapshot" :: held 4.181s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Flow 'volume_create_manager' (e81a011b-332b-4e46-87dc-ad242e696ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e5c1081-464b-4318-8847-f5779d547e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e5c1081-464b-4318-8847-f5779d547e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-421679400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73fe12ec-682c-4631-b095-d1deabf60ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a527ba5949a4e88b56140db740e7d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:15:00Z,use_quota=True,user_id='56033c4d812e4ec48bff7cc1b9223eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41773ae-daf2-4e5f-8ed1-25a8af827756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41773ae-daf2-4e5f-8ed1-25a8af827756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1924624a-4198-45dd-a24c-b2fb8a4eb80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1924624a-4198-45dd-a24c-b2fb8a4eb80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73fe12ec-682c-4631-b095-d1deabf60ff2', 'volume_name': 'volume-73fe12ec-682c-4631-b095-d1deabf60ff2', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c58fb74-45a7-4d9b-9e01-b4ab8e2c4ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c58fb74-45a7-4d9b-9e01-b4ab8e2c4ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506fcb3e-1b2a-40ae-a44d-21f5242b0c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:00 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Volume 73fe12ec-682c-4631-b095-d1deabf60ff2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73fe12ec-682c-4631-b095-d1deabf60ff2', 'volume_size': 1}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-c1cd3c52-49d1-48d4-b100-f7bf2f6485f2 tempest-VolumesExtendTest-283594505 None] Created reservations ['75d53cd7-6b93-485e-92ac-14b488d4b6e4', 'ad8d359a-ac0e-4dbb-bc82-8759f1fe17b6', 'f3cf71a3-6f7b-40e6-b33e-aae12014363f', '07ccfd94-8200-48ef-af8a-55044a99a993'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:15:00 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-c1cd3c52-49d1-48d4-b100-f7bf2f6485f2 tempest-VolumesExtendTest-283594505 None] Delete snapshot completed successfully.
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c1cd3c52-49d1-48d4-b100-f7bf2f6485f2 tempest-VolumesExtendTest-283594505 None] Lock "cinder-3b73e347-daae-4295-b7a8-24a33dffa77b-delete_snapshot" released by "delete_snapshot" :: held 4.478s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:00 devstack sudo[101248]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-02cb75d7-6a4c-44c5-b2af-6d0747687481" returned: 0 in 0.971s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] <== create_volume: return (2288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.291s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.795s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1317334177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e343da-14ae-4658-a902-b8c308c5d9fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a527ba5949a4e88b56140db740e7d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:59Z,use_quota=True,user_id='56033c4d812e4ec48bff7cc1b9223eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Creating volume 96e343da-14ae-4658-a902-b8c308c5d9fb {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:15:00 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-96e343da-14ae-4658-a902-b8c308c5d9fb 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:00 devstack sudo[101254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-96e343da-14ae-4658-a902-b8c308c5d9fb 1073741824
Jul 03 13:15:00 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1537b6a6-b559-4e18-b199-c4136d39bdb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02cb75d7-6a4c-44c5-b2af-6d0747687481', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6049d019-8692-4ab5-8cbb-d7b1fead5c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:00 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Volume volume-02cb75d7-6a4c-44c5-b2af-6d0747687481 (02cb75d7-6a4c-44c5-b2af-6d0747687481): created successfully
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6049d019-8692-4ab5-8cbb-d7b1fead5c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Flow 'volume_create_manager' (bf64dc54-fc75-400a-8b52-1d3f90caecf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:15:00 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-bdefca44-4abb-4824-8190-d9e6f5a86890 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Created volume successfully.
Jul 03 13:15:01 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e6fd9402-3c6e-4bbe-af46-a5952a0813e6 tempest-VolumesExtendTest-283594505 None] Acquiring lock "cinder-f7c46872-09bc-4ca0-816d-fe1a68c7716a-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:01 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e6fd9402-3c6e-4bbe-af46-a5952a0813e6 tempest-VolumesExtendTest-283594505 None] Lock "cinder-f7c46872-09bc-4ca0-816d-fe1a68c7716a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:01 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e6fd9402-3c6e-4bbe-af46-a5952a0813e6 tempest-VolumesExtendTest-283594505 None] Acquiring lock "cinder-quobyte-f7c46872-09bc-4ca0-816d-fe1a68c7716a" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:01 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e6fd9402-3c6e-4bbe-af46-a5952a0813e6 tempest-VolumesExtendTest-283594505 None] Lock "cinder-quobyte-f7c46872-09bc-4ca0-816d-fe1a68c7716a" acquired by "delete_volume" :: waited 0.027s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:01 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1622c6f-a611-4b0a-9d1a-6c3557134b97]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e6fd9402-3c6e-4bbe-af46-a5952a0813e6 tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:01 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-96e343da-14ae-4658-a902-b8c308c5d9fb 1073741824" returned: 0 in 1.158s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:01 devstack sudo[101263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a
Jul 03 13:15:01 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-96e343da-14ae-4658-a902-b8c308c5d9fb {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:02 devstack sudo[101265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-96e343da-14ae-4658-a902-b8c308c5d9fb
Jul 03 13:15:02 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:02 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e6fd9402-3c6e-4bbe-af46-a5952a0813e6 tempest-VolumesExtendTest-283594505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a" returned: 0 in 0.885s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e6fd9402-3c6e-4bbe-af46-a5952a0813e6 tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:02 devstack sudo[101271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a
Jul 03 13:15:02 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:02 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-96e343da-14ae-4658-a902-b8c308c5d9fb" returned: 0 in 0.864s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] <== create_volume: return (2081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:15:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.084s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.219s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1027483181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0b06f6-5bd8-4dc4-a8ef-0540cab60711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a527ba5949a4e88b56140db740e7d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:14:59Z,use_quota=True,user_id='56033c4d812e4ec48bff7cc1b9223eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:15:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Creating volume af0b06f6-5bd8-4dc4-a8ef-0540cab60711 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:15:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:15:02 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:15:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-af0b06f6-5bd8-4dc4-a8ef-0540cab60711 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:02 devstack sudo[101274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-af0b06f6-5bd8-4dc4-a8ef-0540cab60711 1073741824
Jul 03 13:15:02 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3355c841-983d-47b2-ac56-126a1e3b4e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96e343da-14ae-4658-a902-b8c308c5d9fb', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1ee55d-e27c-4b8d-9ffd-0a8d175535ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3123274f-b7aa-4ff2-9cc7-5c7a9b47fc64 tempest-VolumesActionsTest-1233072926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:02 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Volume volume-96e343da-14ae-4658-a902-b8c308c5d9fb (96e343da-14ae-4658-a902-b8c308c5d9fb): created successfully
Jul 03 13:15:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1ee55d-e27c-4b8d-9ffd-0a8d175535ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Flow 'volume_create_manager' (cd76b7c2-2ac6-4b46-956e-3567e3f5ad96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:15:02 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-f97c01b3-06a2-4011-b80e-097b061f5a10 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Created volume successfully.
Jul 03 13:15:03 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e6fd9402-3c6e-4bbe-af46-a5952a0813e6 tempest-VolumesExtendTest-283594505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7c46872-09bc-4ca0-816d-fe1a68c7716a" returned: 0 in 0.898s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:03 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e6fd9402-3c6e-4bbe-af46-a5952a0813e6 tempest-VolumesExtendTest-283594505 None] Lock "cinder-quobyte-f7c46872-09bc-4ca0-816d-fe1a68c7716a" released by "delete_volume" :: held 1.865s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:03 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-e6fd9402-3c6e-4bbe-af46-a5952a0813e6 tempest-VolumesExtendTest-283594505 None] Created reservations ['7fbd3e1b-face-49cb-b4b6-d1d43b12986a', 'f3851a72-13d3-42e4-bd85-0b3cc2a4620e', '38624cb5-7d39-488c-8740-00e19b0be2f5', '8f8fea2c-93be-4c20-8ee2-9fb2403a4eec'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:15:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e6fd9402-3c6e-4bbe-af46-a5952a0813e6 tempest-VolumesExtendTest-283594505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e6fd9402-3c6e-4bbe-af46-a5952a0813e6 tempest-VolumesExtendTest-283594505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:03 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e6fd9402-3c6e-4bbe-af46-a5952a0813e6 tempest-VolumesExtendTest-283594505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:03 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e6fd9402-3c6e-4bbe-af46-a5952a0813e6 tempest-VolumesExtendTest-283594505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e6fd9402-3c6e-4bbe-af46-a5952a0813e6 tempest-VolumesExtendTest-283594505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e6fd9402-3c6e-4bbe-af46-a5952a0813e6 tempest-VolumesExtendTest-283594505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:03 devstack sudo[101281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:15:03 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:03 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-af0b06f6-5bd8-4dc4-a8ef-0540cab60711 1073741824" returned: 0 in 1.000s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-af0b06f6-5bd8-4dc4-a8ef-0540cab60711 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:04 devstack sudo[101283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-af0b06f6-5bd8-4dc4-a8ef-0540cab60711
Jul 03 13:15:04 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:04 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e6fd9402-3c6e-4bbe-af46-a5952a0813e6 tempest-VolumesExtendTest-283594505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.850s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:04 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-e6fd9402-3c6e-4bbe-af46-a5952a0813e6 tempest-VolumesExtendTest-283594505 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:15:04 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-e6fd9402-3c6e-4bbe-af46-a5952a0813e6 tempest-VolumesExtendTest-283594505 None] Deleted volume successfully.
Jul 03 13:15:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e6fd9402-3c6e-4bbe-af46-a5952a0813e6 tempest-VolumesExtendTest-283594505 None] Lock "cinder-f7c46872-09bc-4ca0-816d-fe1a68c7716a-delete_volume" released by "delete_volume" :: held 2.984s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:04 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-af0b06f6-5bd8-4dc4-a8ef-0540cab60711" returned: 0 in 0.748s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:15:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.600s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-883203210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4dcddc5-cefa-4c65-b89a-d1cf451cd354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a527ba5949a4e88b56140db740e7d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:15:00Z,use_quota=True,user_id='56033c4d812e4ec48bff7cc1b9223eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:15:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Creating volume e4dcddc5-cefa-4c65-b89a-d1cf451cd354 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:15:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:15:04 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:15:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4dcddc5-cefa-4c65-b89a-d1cf451cd354 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:04 devstack sudo[101287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4dcddc5-cefa-4c65-b89a-d1cf451cd354 1073741824
Jul 03 13:15:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eba5412-8f2c-4991-9ad5-226a117c3529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af0b06f6-5bd8-4dc4-a8ef-0540cab60711', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:04 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229bbdd5-1e1f-4a0c-9732-2409ec35c88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:04 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Volume volume-af0b06f6-5bd8-4dc4-a8ef-0540cab60711 (af0b06f6-5bd8-4dc4-a8ef-0540cab60711): created successfully
Jul 03 13:15:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229bbdd5-1e1f-4a0c-9732-2409ec35c88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Flow 'volume_create_manager' (2f345c71-5c8b-4c30-aefc-a1fa6d8aacad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:15:04 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-643b20e5-4649-45c1-8e92-fc49c0dfeb0b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Created volume successfully.
Jul 03 13:15:05 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4dcddc5-cefa-4c65-b89a-d1cf451cd354 1073741824" returned: 0 in 1.107s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4dcddc5-cefa-4c65-b89a-d1cf451cd354 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:05 devstack sudo[101293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4dcddc5-cefa-4c65-b89a-d1cf451cd354
Jul 03 13:15:05 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:06 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4dcddc5-cefa-4c65-b89a-d1cf451cd354" returned: 0 in 0.728s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:15:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.041s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-421679400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73fe12ec-682c-4631-b095-d1deabf60ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a527ba5949a4e88b56140db740e7d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:15:00Z,use_quota=True,user_id='56033c4d812e4ec48bff7cc1b9223eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:15:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Creating volume 73fe12ec-682c-4631-b095-d1deabf60ff2 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:15:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:15:06 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:15:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73fe12ec-682c-4631-b095-d1deabf60ff2 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:06 devstack sudo[101296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73fe12ec-682c-4631-b095-d1deabf60ff2 1073741824
Jul 03 13:15:06 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9562722b-294e-40fb-b85b-e27aedbb2b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4dcddc5-cefa-4c65-b89a-d1cf451cd354', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1b9449-5e26-4b3c-b2ec-52f1cad08fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:06 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Volume volume-e4dcddc5-cefa-4c65-b89a-d1cf451cd354 (e4dcddc5-cefa-4c65-b89a-d1cf451cd354): created successfully
Jul 03 13:15:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1b9449-5e26-4b3c-b2ec-52f1cad08fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Flow 'volume_create_manager' (50491625-7079-470f-ae6c-8840ed67da63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:15:06 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-412a63bd-6665-4bb2-81da-43f6108f0b2b tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Created volume successfully.
Jul 03 13:15:07 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:15:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Flow 'volume_create_manager' (2c37b7fc-3fa4-44a5-bcba-9c167b903ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:15:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c8ff05-4e41-4c06-83a2-78456baf464c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c8ff05-4e41-4c06-83a2-78456baf464c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2088442514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff8fd3ec-94e5-422d-b6f6-79fc6a6cbf8d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='487e2b50c3ab49d08c8282b6a919c127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:15:07Z,use_quota=True,user_id='4dc071788e874546a9bb14e00e9ded46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01b5ab0-632a-4265-9588-48ca6b40adcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01b5ab0-632a-4265-9588-48ca6b40adcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf75d15-285c-431c-8cda-b862da702c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf75d15-285c-431c-8cda-b862da702c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff8fd3ec-94e5-422d-b6f6-79fc6a6cbf8d', 'volume_name': 'volume-ff8fd3ec-94e5-422d-b6f6-79fc6a6cbf8d', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82887335-8f60-4afc-98d4-abacacb37e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82887335-8f60-4afc-98d4-abacacb37e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e661f4e6-2c1d-4e2a-8201-bf3c70da1730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:07 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Volume ff8fd3ec-94e5-422d-b6f6-79fc6a6cbf8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff8fd3ec-94e5-422d-b6f6-79fc6a6cbf8d', 'volume_size': 1}
Jul 03 13:15:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:07 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73fe12ec-682c-4631-b095-d1deabf60ff2 1073741824" returned: 0 in 1.052s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73fe12ec-682c-4631-b095-d1deabf60ff2 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:07 devstack sudo[101301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73fe12ec-682c-4631-b095-d1deabf60ff2
Jul 03 13:15:07 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:08 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73fe12ec-682c-4631-b095-d1deabf60ff2" returned: 0 in 0.624s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:15:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3123274f-b7aa-4ff2-9cc7-5c7a9b47fc64 tempest-VolumesActionsTest-1233072926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 5.392s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506fcb3e-1b2a-40ae-a44d-21f5242b0c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73fe12ec-682c-4631-b095-d1deabf60ff2', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f28aaa-40b7-4cba-894d-fa6f8d41bb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:08 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ad9748-6324-4194-8ce7-50968f0eacaf]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3123274f-b7aa-4ff2-9cc7-5c7a9b47fc64 tempest-VolumesActionsTest-1233072926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:08 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Volume volume-73fe12ec-682c-4631-b095-d1deabf60ff2 (73fe12ec-682c-4631-b095-d1deabf60ff2): created successfully
Jul 03 13:15:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f28aaa-40b7-4cba-894d-fa6f8d41bb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Flow 'volume_create_manager' (e81a011b-332b-4e46-87dc-ad242e696ac0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:15:08 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-9d56f3b9-ecd1-4424-a358-7dd9c25961f1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Created volume successfully.
Jul 03 13:15:08 devstack sudo[101304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08
Jul 03 13:15:08 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:09 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3123274f-b7aa-4ff2-9cc7-5c7a9b47fc64 tempest-VolumesActionsTest-1233072926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08" returned: 0 in 0.859s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:09 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e03127f-acaa-45d9-8e74-8e9d261b5a8f]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3123274f-b7aa-4ff2-9cc7-5c7a9b47fc64 tempest-VolumesActionsTest-1233072926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:09 devstack sudo[101309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08
Jul 03 13:15:09 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-488564c8-4dfd-4425-8c20-a8e636d6c8ec tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "cinder-73fe12ec-682c-4631-b095-d1deabf60ff2-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-488564c8-4dfd-4425-8c20-a8e636d6c8ec tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "cinder-73fe12ec-682c-4631-b095-d1deabf60ff2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-488564c8-4dfd-4425-8c20-a8e636d6c8ec tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "cinder-quobyte-73fe12ec-682c-4631-b095-d1deabf60ff2" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-488564c8-4dfd-4425-8c20-a8e636d6c8ec tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "cinder-quobyte-73fe12ec-682c-4631-b095-d1deabf60ff2" acquired by "delete_volume" :: waited 0.022s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:09 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d49c75-12b0-478f-bb10-bff52ff9ac9f]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-488564c8-4dfd-4425-8c20-a8e636d6c8ec tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73fe12ec-682c-4631-b095-d1deabf60ff2 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:09 devstack sudo[101311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73fe12ec-682c-4631-b095-d1deabf60ff2
Jul 03 13:15:09 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:10 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3123274f-b7aa-4ff2-9cc7-5c7a9b47fc64 tempest-VolumesActionsTest-1233072926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08" returned: 0 in 0.836s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3123274f-b7aa-4ff2-9cc7-5c7a9b47fc64 tempest-VolumesActionsTest-1233072926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08 /opt/stack/data/cinder/conversion/a48610e8-fc44-472b-834a-d2e155b6be08.temp_image.5ff7ffe4-5c75-4afe-b6bc-211c1c6133f66xe7294e.img {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:10 devstack sudo[101316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08 /opt/stack/data/cinder/conversion/a48610e8-fc44-472b-834a-d2e155b6be08.temp_image.5ff7ffe4-5c75-4afe-b6bc-211c1c6133f66xe7294e.img
Jul 03 13:15:10 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:10 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-488564c8-4dfd-4425-8c20-a8e636d6c8ec tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73fe12ec-682c-4631-b095-d1deabf60ff2" returned: 0 in 0.802s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-488564c8-4dfd-4425-8c20-a8e636d6c8ec tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73fe12ec-682c-4631-b095-d1deabf60ff2 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:10 devstack sudo[101321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73fe12ec-682c-4631-b095-d1deabf60ff2
Jul 03 13:15:10 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:11 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-488564c8-4dfd-4425-8c20-a8e636d6c8ec tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73fe12ec-682c-4631-b095-d1deabf60ff2" returned: 0 in 0.887s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:11 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-488564c8-4dfd-4425-8c20-a8e636d6c8ec tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "cinder-quobyte-73fe12ec-682c-4631-b095-d1deabf60ff2" released by "delete_volume" :: held 1.762s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:11 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-488564c8-4dfd-4425-8c20-a8e636d6c8ec tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Created reservations ['de5ff703-60bb-46a0-8bee-341ba3c224d7', '1bbeafea-88e5-4708-95ba-e3b64014aeee', '9867751d-6ebd-4699-99dd-21f8ed22dd91', 'e85ecdf1-e1df-4558-86df-9189b0de4f77'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:15:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-488564c8-4dfd-4425-8c20-a8e636d6c8ec tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-488564c8-4dfd-4425-8c20-a8e636d6c8ec tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-488564c8-4dfd-4425-8c20-a8e636d6c8ec tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-488564c8-4dfd-4425-8c20-a8e636d6c8ec tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-488564c8-4dfd-4425-8c20-a8e636d6c8ec tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-488564c8-4dfd-4425-8c20-a8e636d6c8ec tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:11 devstack sudo[101335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:15:11 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:11 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-42898ed2-c6e0-490c-b98a-17bea8df5edb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "cinder-e4dcddc5-cefa-4c65-b89a-d1cf451cd354-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-42898ed2-c6e0-490c-b98a-17bea8df5edb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "cinder-e4dcddc5-cefa-4c65-b89a-d1cf451cd354-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-42898ed2-c6e0-490c-b98a-17bea8df5edb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "cinder-quobyte-e4dcddc5-cefa-4c65-b89a-d1cf451cd354" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-42898ed2-c6e0-490c-b98a-17bea8df5edb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "cinder-quobyte-e4dcddc5-cefa-4c65-b89a-d1cf451cd354" acquired by "delete_volume" :: waited 0.054s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:12 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b892aee-aa91-4556-92ca-3c5a041e70f7]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-42898ed2-c6e0-490c-b98a-17bea8df5edb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4dcddc5-cefa-4c65-b89a-d1cf451cd354 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:12 devstack sudo[101337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4dcddc5-cefa-4c65-b89a-d1cf451cd354
Jul 03 13:15:12 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:13 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-488564c8-4dfd-4425-8c20-a8e636d6c8ec tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.955s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:13 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-488564c8-4dfd-4425-8c20-a8e636d6c8ec tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:15:13 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-488564c8-4dfd-4425-8c20-a8e636d6c8ec tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Deleted volume successfully.
Jul 03 13:15:14 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-42898ed2-c6e0-490c-b98a-17bea8df5edb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4dcddc5-cefa-4c65-b89a-d1cf451cd354" returned: 0 in 1.642s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-42898ed2-c6e0-490c-b98a-17bea8df5edb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4dcddc5-cefa-4c65-b89a-d1cf451cd354 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:14 devstack sudo[101345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4dcddc5-cefa-4c65-b89a-d1cf451cd354
Jul 03 13:15:14 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-488564c8-4dfd-4425-8c20-a8e636d6c8ec tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "cinder-73fe12ec-682c-4631-b095-d1deabf60ff2-delete_volume" released by "delete_volume" :: held 5.370s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:15:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:15 devstack sudo[101347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:15:15 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:15 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3123274f-b7aa-4ff2-9cc7-5c7a9b47fc64 tempest-VolumesActionsTest-1233072926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08 /opt/stack/data/cinder/conversion/a48610e8-fc44-472b-834a-d2e155b6be08.temp_image.5ff7ffe4-5c75-4afe-b6bc-211c1c6133f66xe7294e.img" returned: 0 in 5.126s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:15 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ef5ac9-b1d2-4540-b4fc-05ad466b1345]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3123274f-b7aa-4ff2-9cc7-5c7a9b47fc64 tempest-VolumesActionsTest-1233072926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:15 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-42898ed2-c6e0-490c-b98a-17bea8df5edb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4dcddc5-cefa-4c65-b89a-d1cf451cd354" returned: 0 in 1.190s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:15 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-42898ed2-c6e0-490c-b98a-17bea8df5edb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "cinder-quobyte-e4dcddc5-cefa-4c65-b89a-d1cf451cd354" released by "delete_volume" :: held 2.918s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:15 devstack sudo[101350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08
Jul 03 13:15:15 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:15 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.784s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:15 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:15:15 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:15:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 28 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:15:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>, <Thread(tpool_thread_0, started daemon 134850092431040)>, <Thread(tpool_thread_1, started daemon 134850084021952)>, <Thread(tpool_thread_2, started daemon 134850075612864)>, <Thread(tpool_thread_3, started daemon 134850067203776)>, <Thread(tpool_thread_4, started daemon 134850058794688)>, <Thread(tpool_thread_5, started daemon 134850050385600)>, <Thread(tpool_thread_6, started daemon 134850041976512)>, <Thread(tpool_thread_7, started daemon 134850033567424)>, <Thread(tpool_thread_8, started daemon 134850025158336)>, <Thread(tpool_thread_9, started daemon 134850016749248)>, <Thread(tpool_thread_10, started daemon 134850008340160)>, <Thread(tpool_thread_11, started daemon 134849999931072)>, <Thread(tpool_thread_12, started daemon 134849991521984)>, <Thread(tpool_thread_13, started daemon 134849983112896)>, <Thread(tpool_thread_14, started daemon 134849974703808)>, <Thread(tpool_thread_15, started daemon 134849966294720)>, <Thread(tpool_thread_16, started daemon 134849957885632)>, <Thread(tpool_thread_17, started daemon 134849949476544)>, <Thread(tpool_thread_18, started daemon 134849941067456)>, <Thread(tpool_thread_19, started daemon 134849932658368)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:15:16 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3123274f-b7aa-4ff2-9cc7-5c7a9b47fc64 tempest-VolumesActionsTest-1233072926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08" returned: 0 in 0.948s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:16 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-3123274f-b7aa-4ff2-9cc7-5c7a9b47fc64 tempest-VolumesActionsTest-1233072926 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08, size 1024.00 MB, duration 5.13 sec, destination /opt/stack/data/cinder/conversion/a48610e8-fc44-472b-834a-d2e155b6be08.temp_image.5ff7ffe4-5c75-4afe-b6bc-211c1c6133f66xe7294e.img {{(pid=86837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 13:15:16 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-3123274f-b7aa-4ff2-9cc7-5c7a9b47fc64 tempest-VolumesActionsTest-1233072926 None] Converted 1024.00 MB image at 199.69 MB/s
Jul 03 13:15:16 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-3123274f-b7aa-4ff2-9cc7-5c7a9b47fc64 tempest-VolumesActionsTest-1233072926 None] 5ff7ffe4-5c75-4afe-b6bc-211c1c6133f6 was raw, no need to convert to raw {{(pid=86837) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jul 03 13:15:16 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-42898ed2-c6e0-490c-b98a-17bea8df5edb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Created reservations ['859b3619-6e67-4f6a-a869-788b84bec1e4', '52b6a889-02cd-45cf-9b23-f4ef12965941', '4b01c9ca-a77f-4b1a-8391-a16d614a954f', '141237bd-62e8-4938-ba1c-09cceedf6d0c'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:15:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-42898ed2-c6e0-490c-b98a-17bea8df5edb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-42898ed2-c6e0-490c-b98a-17bea8df5edb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:16 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-42898ed2-c6e0-490c-b98a-17bea8df5edb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:16 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-42898ed2-c6e0-490c-b98a-17bea8df5edb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-42898ed2-c6e0-490c-b98a-17bea8df5edb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-42898ed2-c6e0-490c-b98a-17bea8df5edb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:17 devstack sudo[101356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:15:17 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e8c19594-bd68-4302-8b5a-9159aaba15b6 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "cinder-af0b06f6-5bd8-4dc4-a8ef-0540cab60711-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e8c19594-bd68-4302-8b5a-9159aaba15b6 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "cinder-af0b06f6-5bd8-4dc4-a8ef-0540cab60711-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:17 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-42898ed2-c6e0-490c-b98a-17bea8df5edb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.713s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:17 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-42898ed2-c6e0-490c-b98a-17bea8df5edb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:15:17 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-42898ed2-c6e0-490c-b98a-17bea8df5edb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Deleted volume successfully.
Jul 03 13:15:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e8c19594-bd68-4302-8b5a-9159aaba15b6 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "cinder-quobyte-af0b06f6-5bd8-4dc4-a8ef-0540cab60711" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-42898ed2-c6e0-490c-b98a-17bea8df5edb tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "cinder-e4dcddc5-cefa-4c65-b89a-d1cf451cd354-delete_volume" released by "delete_volume" :: held 5.722s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e8c19594-bd68-4302-8b5a-9159aaba15b6 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "cinder-quobyte-af0b06f6-5bd8-4dc4-a8ef-0540cab60711" acquired by "delete_volume" :: waited 0.022s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:17 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fb672c-80c7-42d7-bd0e-d280966de7a5]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e8c19594-bd68-4302-8b5a-9159aaba15b6 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-af0b06f6-5bd8-4dc4-a8ef-0540cab60711 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:17 devstack sudo[101359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-af0b06f6-5bd8-4dc4-a8ef-0540cab60711
Jul 03 13:15:17 devstack sudo[101359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:18 devstack sudo[101359]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e8c19594-bd68-4302-8b5a-9159aaba15b6 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-af0b06f6-5bd8-4dc4-a8ef-0540cab60711" returned: 0 in 0.816s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e8c19594-bd68-4302-8b5a-9159aaba15b6 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-af0b06f6-5bd8-4dc4-a8ef-0540cab60711 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:18 devstack sudo[101364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-af0b06f6-5bd8-4dc4-a8ef-0540cab60711
Jul 03 13:15:18 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:19 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e8c19594-bd68-4302-8b5a-9159aaba15b6 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-af0b06f6-5bd8-4dc4-a8ef-0540cab60711" returned: 0 in 0.735s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:19 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e8c19594-bd68-4302-8b5a-9159aaba15b6 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "cinder-quobyte-af0b06f6-5bd8-4dc4-a8ef-0540cab60711" released by "delete_volume" :: held 1.600s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:19 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-e8c19594-bd68-4302-8b5a-9159aaba15b6 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Created reservations ['31db679a-18c4-4fdf-bb96-cf10fbcaf100', '564ffc82-e62a-470e-a8ba-07f0a905aa47', '4f622651-47eb-4474-8968-e256a1d9b489', '4ba91a67-f6cd-4629-9b83-8ccf7bb6a2d9'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:15:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e8c19594-bd68-4302-8b5a-9159aaba15b6 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e8c19594-bd68-4302-8b5a-9159aaba15b6 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:19 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e8c19594-bd68-4302-8b5a-9159aaba15b6 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:19 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e8c19594-bd68-4302-8b5a-9159aaba15b6 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e8c19594-bd68-4302-8b5a-9159aaba15b6 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e8c19594-bd68-4302-8b5a-9159aaba15b6 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:19 devstack sudo[101367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:15:19 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:19 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-41ee1de9-cd67-4f79-9255-5eabd3d6bfc1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "cinder-96e343da-14ae-4658-a902-b8c308c5d9fb-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:19 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-41ee1de9-cd67-4f79-9255-5eabd3d6bfc1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "cinder-96e343da-14ae-4658-a902-b8c308c5d9fb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-41ee1de9-cd67-4f79-9255-5eabd3d6bfc1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "cinder-quobyte-96e343da-14ae-4658-a902-b8c308c5d9fb" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-41ee1de9-cd67-4f79-9255-5eabd3d6bfc1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "cinder-quobyte-96e343da-14ae-4658-a902-b8c308c5d9fb" acquired by "delete_volume" :: waited 0.039s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:20 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3825d319-0536-4563-b83c-646ec541be52]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-41ee1de9-cd67-4f79-9255-5eabd3d6bfc1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-96e343da-14ae-4658-a902-b8c308c5d9fb {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:20 devstack sudo[101403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-96e343da-14ae-4658-a902-b8c308c5d9fb
Jul 03 13:15:20 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:20 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e8c19594-bd68-4302-8b5a-9159aaba15b6 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.953s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:20 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-e8c19594-bd68-4302-8b5a-9159aaba15b6 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:15:20 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-e8c19594-bd68-4302-8b5a-9159aaba15b6 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Deleted volume successfully.
Jul 03 13:15:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e8c19594-bd68-4302-8b5a-9159aaba15b6 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "cinder-af0b06f6-5bd8-4dc4-a8ef-0540cab60711-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:21 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-41ee1de9-cd67-4f79-9255-5eabd3d6bfc1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-96e343da-14ae-4658-a902-b8c308c5d9fb" returned: 0 in 0.955s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-41ee1de9-cd67-4f79-9255-5eabd3d6bfc1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-96e343da-14ae-4658-a902-b8c308c5d9fb {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:21 devstack sudo[101411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-96e343da-14ae-4658-a902-b8c308c5d9fb
Jul 03 13:15:21 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:21 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-41ee1de9-cd67-4f79-9255-5eabd3d6bfc1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-96e343da-14ae-4658-a902-b8c308c5d9fb" returned: 0 in 0.732s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:21 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-41ee1de9-cd67-4f79-9255-5eabd3d6bfc1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "cinder-quobyte-96e343da-14ae-4658-a902-b8c308c5d9fb" released by "delete_volume" :: held 1.777s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:21 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:INSERT=32,cinder:SELECT=78,cinder:UPDATE=98,cinder:DELETE=9 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:15:21 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=89,cinder:INSERT=22,cinder:UPDATE=87,cinder:DELETE=6 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:15:22 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-41ee1de9-cd67-4f79-9255-5eabd3d6bfc1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Created reservations ['3b74a3d8-37cc-47e4-bdbe-3bd23e8d6bfa', '88d3968c-3d84-40e5-a1bc-9a04972c8035', 'd482fac6-d4b5-469d-9e10-f9243ecdf78b', '350867d9-84bc-470f-8f2a-20087c3bc907'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:15:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-41ee1de9-cd67-4f79-9255-5eabd3d6bfc1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-41ee1de9-cd67-4f79-9255-5eabd3d6bfc1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:22 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-41ee1de9-cd67-4f79-9255-5eabd3d6bfc1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:22 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-41ee1de9-cd67-4f79-9255-5eabd3d6bfc1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-41ee1de9-cd67-4f79-9255-5eabd3d6bfc1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-41ee1de9-cd67-4f79-9255-5eabd3d6bfc1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:22 devstack sudo[101414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:15:22 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:22 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8effbf62-8177-4886-bca1-d38b1b449a72 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "cinder-02cb75d7-6a4c-44c5-b2af-6d0747687481-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:22 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8effbf62-8177-4886-bca1-d38b1b449a72 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "cinder-02cb75d7-6a4c-44c5-b2af-6d0747687481-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:22 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8effbf62-8177-4886-bca1-d38b1b449a72 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "cinder-quobyte-02cb75d7-6a4c-44c5-b2af-6d0747687481" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:22 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8effbf62-8177-4886-bca1-d38b1b449a72 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "cinder-quobyte-02cb75d7-6a4c-44c5-b2af-6d0747687481" acquired by "delete_volume" :: waited 0.024s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:22 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[372aaa54-ff87-4d9e-b14d-2b926410111e]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8effbf62-8177-4886-bca1-d38b1b449a72 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-02cb75d7-6a4c-44c5-b2af-6d0747687481 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:22 devstack sudo[101416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-02cb75d7-6a4c-44c5-b2af-6d0747687481
Jul 03 13:15:22 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:23 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-41ee1de9-cd67-4f79-9255-5eabd3d6bfc1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.913s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:23 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-41ee1de9-cd67-4f79-9255-5eabd3d6bfc1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:15:23 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-41ee1de9-cd67-4f79-9255-5eabd3d6bfc1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Deleted volume successfully.
Jul 03 13:15:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-41ee1de9-cd67-4f79-9255-5eabd3d6bfc1 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "cinder-96e343da-14ae-4658-a902-b8c308c5d9fb-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:23 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8effbf62-8177-4886-bca1-d38b1b449a72 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-02cb75d7-6a4c-44c5-b2af-6d0747687481" returned: 0 in 0.985s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8effbf62-8177-4886-bca1-d38b1b449a72 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-02cb75d7-6a4c-44c5-b2af-6d0747687481 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:23 devstack sudo[101429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-02cb75d7-6a4c-44c5-b2af-6d0747687481
Jul 03 13:15:23 devstack sudo[101429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:24 devstack sudo[101429]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8effbf62-8177-4886-bca1-d38b1b449a72 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-02cb75d7-6a4c-44c5-b2af-6d0747687481" returned: 0 in 0.677s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8effbf62-8177-4886-bca1-d38b1b449a72 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "cinder-quobyte-02cb75d7-6a4c-44c5-b2af-6d0747687481" released by "delete_volume" :: held 1.721s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:24 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-8effbf62-8177-4886-bca1-d38b1b449a72 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Created reservations ['c098d876-4cee-4486-9f9c-21234a00190a', '4ea44cfc-03db-42bf-a625-f8a3d56d3bd7', 'd338f177-5456-47c9-b7b2-9570404e672f', '86db67eb-ef1d-43e8-af6e-64b8c0a12199'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:15:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8effbf62-8177-4886-bca1-d38b1b449a72 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8effbf62-8177-4886-bca1-d38b1b449a72 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8effbf62-8177-4886-bca1-d38b1b449a72 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8effbf62-8177-4886-bca1-d38b1b449a72 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8effbf62-8177-4886-bca1-d38b1b449a72 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8effbf62-8177-4886-bca1-d38b1b449a72 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:24 devstack sudo[101432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:15:24 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f3d18e02-c1e5-4744-b7c2-9e3640e33e9f tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "cinder-227cd5bf-01fa-4557-8275-4cd43b28ae7b-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f3d18e02-c1e5-4744-b7c2-9e3640e33e9f tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "cinder-227cd5bf-01fa-4557-8275-4cd43b28ae7b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f3d18e02-c1e5-4744-b7c2-9e3640e33e9f tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "cinder-quobyte-227cd5bf-01fa-4557-8275-4cd43b28ae7b" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f3d18e02-c1e5-4744-b7c2-9e3640e33e9f tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "cinder-quobyte-227cd5bf-01fa-4557-8275-4cd43b28ae7b" acquired by "delete_volume" :: waited 0.040s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:24 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a490d41-174b-4484-b836-5a0619067c3d]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f3d18e02-c1e5-4744-b7c2-9e3640e33e9f tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-227cd5bf-01fa-4557-8275-4cd43b28ae7b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:24 devstack sudo[101434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-227cd5bf-01fa-4557-8275-4cd43b28ae7b
Jul 03 13:15:24 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:25 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8effbf62-8177-4886-bca1-d38b1b449a72 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.086s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:25 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-8effbf62-8177-4886-bca1-d38b1b449a72 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:15:25 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-8effbf62-8177-4886-bca1-d38b1b449a72 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Deleted volume successfully.
Jul 03 13:15:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8effbf62-8177-4886-bca1-d38b1b449a72 tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "cinder-02cb75d7-6a4c-44c5-b2af-6d0747687481-delete_volume" released by "delete_volume" :: held 3.168s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:25 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f3d18e02-c1e5-4744-b7c2-9e3640e33e9f tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-227cd5bf-01fa-4557-8275-4cd43b28ae7b" returned: 0 in 0.970s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f3d18e02-c1e5-4744-b7c2-9e3640e33e9f tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-227cd5bf-01fa-4557-8275-4cd43b28ae7b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:25 devstack sudo[101440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-227cd5bf-01fa-4557-8275-4cd43b28ae7b
Jul 03 13:15:25 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:26 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f3d18e02-c1e5-4744-b7c2-9e3640e33e9f tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-227cd5bf-01fa-4557-8275-4cd43b28ae7b" returned: 0 in 0.786s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:26 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f3d18e02-c1e5-4744-b7c2-9e3640e33e9f tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "cinder-quobyte-227cd5bf-01fa-4557-8275-4cd43b28ae7b" released by "delete_volume" :: held 1.819s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:26 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-f3d18e02-c1e5-4744-b7c2-9e3640e33e9f tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Created reservations ['4bdc9e9d-61fa-484b-9d40-bbac1b1b8127', 'c2b3cb66-3ffe-40ba-823f-05c5a9453231', 'd0ba815e-0c73-4045-8b38-b000e58ad4ff', '1e56ec99-04c2-4ddb-b4c7-8a15b9613d91'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:15:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f3d18e02-c1e5-4744-b7c2-9e3640e33e9f tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f3d18e02-c1e5-4744-b7c2-9e3640e33e9f tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f3d18e02-c1e5-4744-b7c2-9e3640e33e9f tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f3d18e02-c1e5-4744-b7c2-9e3640e33e9f tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f3d18e02-c1e5-4744-b7c2-9e3640e33e9f tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f3d18e02-c1e5-4744-b7c2-9e3640e33e9f tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:26 devstack sudo[101443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:15:26 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:27 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f3d18e02-c1e5-4744-b7c2-9e3640e33e9f tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.951s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:27 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f3d18e02-c1e5-4744-b7c2-9e3640e33e9f tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:15:27 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-f3d18e02-c1e5-4744-b7c2-9e3640e33e9f tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Deleted volume successfully.
Jul 03 13:15:27 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f3d18e02-c1e5-4744-b7c2-9e3640e33e9f tempest-CreateVolumesFromSourceVolumeTest-1171978883 None] Lock "cinder-227cd5bf-01fa-4557-8275-4cd43b28ae7b-delete_volume" released by "delete_volume" :: held 3.125s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:31 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:15:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Flow 'volume_create_manager' (9697372c-879c-495b-a442-c2495360f823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:15:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f417e616-1d7c-4ced-a134-5b9ada1c4da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f417e616-1d7c-4ced-a134-5b9ada1c4da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-175516434',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f661da-eb9a-4484-b1ed-7f7ac8706d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f909f245dab945a2ba9d7f62cea59765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:15:32Z,use_quota=True,user_id='67894a1f41744532839b53cb023e2a71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eedf4d7-fbdb-40c4-908d-ca2366a3f36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eedf4d7-fbdb-40c4-908d-ca2366a3f36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e768560e-3b56-42c4-a9f5-87dac96169da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e768560e-3b56-42c4-a9f5-87dac96169da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66f661da-eb9a-4484-b1ed-7f7ac8706d93', 'volume_name': 'volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba8d6b9-edc5-4391-8e89-9a2b8762eab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba8d6b9-edc5-4391-8e89-9a2b8762eab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96e5223-4771-4dcc-8629-0d9e18a7f18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:31 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Volume 66f661da-eb9a-4484-b1ed-7f7ac8706d93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93', 'volume_size': 1}
Jul 03 13:15:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3123274f-b7aa-4ff2-9cc7-5c7a9b47fc64 tempest-VolumesActionsTest-1233072926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.755s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3123274f-b7aa-4ff2-9cc7-5c7a9b47fc64 tempest-VolumesActionsTest-1233072926 None] Uploaded volume to glance image-id: 5ff7ffe4-5c75-4afe-b6bc-211c1c6133f6. {{(pid=86837) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 03 13:15:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 29.527s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2088442514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff8fd3ec-94e5-422d-b6f6-79fc6a6cbf8d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='487e2b50c3ab49d08c8282b6a919c127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:15:07Z,use_quota=True,user_id='4dc071788e874546a9bb14e00e9ded46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:15:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Creating volume ff8fd3ec-94e5-422d-b6f6-79fc6a6cbf8d {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:15:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:15:37 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:15:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ff8fd3ec-94e5-422d-b6f6-79fc6a6cbf8d 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:37 devstack sudo[101448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ff8fd3ec-94e5-422d-b6f6-79fc6a6cbf8d 1073741824
Jul 03 13:15:37 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:37 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-3123274f-b7aa-4ff2-9cc7-5c7a9b47fc64 tempest-VolumesActionsTest-1233072926 None] Copy volume to image completed successfully.
Jul 03 13:15:38 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ff8fd3ec-94e5-422d-b6f6-79fc6a6cbf8d 1073741824" returned: 0 in 0.963s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ff8fd3ec-94e5-422d-b6f6-79fc6a6cbf8d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:38 devstack sudo[101454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ff8fd3ec-94e5-422d-b6f6-79fc6a6cbf8d
Jul 03 13:15:38 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-39663b24-2f78-4f88-a99e-7df2be622fba tempest-VolumesActionsTest-1233072926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:38 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ff8fd3ec-94e5-422d-b6f6-79fc6a6cbf8d" returned: 0 in 0.758s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:38 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:15:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.208s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:38 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-175516434',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66f661da-eb9a-4484-b1ed-7f7ac8706d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f909f245dab945a2ba9d7f62cea59765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:15:32Z,use_quota=True,user_id='67894a1f41744532839b53cb023e2a71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:15:38 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Creating volume 66f661da-eb9a-4484-b1ed-7f7ac8706d93 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:15:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:38 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:38 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:38 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:15:38 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:15:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:38 devstack sudo[101457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93 1073741824
Jul 03 13:15:38 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e661f4e6-2c1d-4e2a-8201-bf3c70da1730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff8fd3ec-94e5-422d-b6f6-79fc6a6cbf8d', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f622cf26-396a-4cb1-9285-60ef1823048a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:39 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Volume volume-ff8fd3ec-94e5-422d-b6f6-79fc6a6cbf8d (ff8fd3ec-94e5-422d-b6f6-79fc6a6cbf8d): created successfully
Jul 03 13:15:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f622cf26-396a-4cb1-9285-60ef1823048a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Flow 'volume_create_manager' (2c37b7fc-3fa4-44a5-bcba-9c167b903ab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:15:39 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-b22857c6-f244-4160-b3e8-800cd5e37eb7 tempest-VolumesListTestJSON-1589415074 None] Created volume successfully.
Jul 03 13:15:39 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:15:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Flow 'volume_create_manager' (18657118-9f39-492a-8899-d03677d5d057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:15:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99d819b-4689-4927-a216-610cbe8f600e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99d819b-4689-4927-a216-610cbe8f600e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-38329693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c1bc22-d0e2-40e0-bfe2-73f8b6358df8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='487e2b50c3ab49d08c8282b6a919c127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:15:40Z,use_quota=True,user_id='4dc071788e874546a9bb14e00e9ded46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b85e0cb9-85c6-4068-9e21-9fd716aec29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b85e0cb9-85c6-4068-9e21-9fd716aec29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acaef4d1-ff92-4751-bef6-0bf1b8a246cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acaef4d1-ff92-4751-bef6-0bf1b8a246cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70c1bc22-d0e2-40e0-bfe2-73f8b6358df8', 'volume_name': 'volume-70c1bc22-d0e2-40e0-bfe2-73f8b6358df8', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ecc91ff-10ac-493f-97b7-841fb8675220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ecc91ff-10ac-493f-97b7-841fb8675220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1487b1e3-bca8-4f5f-96a9-fdb02fe79777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:39 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Volume 70c1bc22-d0e2-40e0-bfe2-73f8b6358df8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70c1bc22-d0e2-40e0-bfe2-73f8b6358df8', 'volume_size': 1}
Jul 03 13:15:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:39 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93 1073741824" returned: 0 in 1.005s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:39 devstack sudo[101463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93
Jul 03 13:15:39 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:40 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93" returned: 0 in 0.653s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:40 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:15:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-39663b24-2f78-4f88-a99e-7df2be622fba tempest-VolumesActionsTest-1233072926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.093s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:40 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96e5223-4771-4dcc-8629-0d9e18a7f18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:40 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e642070-dacb-4b8f-95b3-c84311d30775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:40 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[083853dd-580a-4d8c-8e2e-46de77ad379b]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-39663b24-2f78-4f88-a99e-7df2be622fba tempest-VolumesActionsTest-1233072926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:40 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Volume volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93 (66f661da-eb9a-4484-b1ed-7f7ac8706d93): created successfully
Jul 03 13:15:40 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e642070-dacb-4b8f-95b3-c84311d30775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:40 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Flow 'volume_create_manager' (9697372c-879c-495b-a442-c2495360f823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:15:40 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-be829d09-d492-4897-bfa0-cbb5c26b9fff tempest-VolumeDependencyTests-1186088160 None] Created volume successfully.
Jul 03 13:15:40 devstack sudo[101466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08
Jul 03 13:15:40 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ce6027ff-c27b-457a-a218-7b35fb831c97 tempest-VolumeDependencyTests-1186088160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:41 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-39663b24-2f78-4f88-a99e-7df2be622fba tempest-VolumesActionsTest-1233072926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08" returned: 0 in 0.836s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:41 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b62e529-1b98-4c34-a590-21c516e9cd3e]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-39663b24-2f78-4f88-a99e-7df2be622fba tempest-VolumesActionsTest-1233072926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:41 devstack sudo[101471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08
Jul 03 13:15:41 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:42 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-39663b24-2f78-4f88-a99e-7df2be622fba tempest-VolumesActionsTest-1233072926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08" returned: 0 in 0.786s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-39663b24-2f78-4f88-a99e-7df2be622fba tempest-VolumesActionsTest-1233072926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08 /opt/stack/data/cinder/conversion/a48610e8-fc44-472b-834a-d2e155b6be08.temp_image.cd224fb8-2cf4-443c-9dcc-9c4a2ffe328ah9kmx0ff.img {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:42 devstack sudo[101476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08 /opt/stack/data/cinder/conversion/a48610e8-fc44-472b-834a-d2e155b6be08.temp_image.cd224fb8-2cf4-443c-9dcc-9c4a2ffe328ah9kmx0ff.img
Jul 03 13:15:42 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:47 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-39663b24-2f78-4f88-a99e-7df2be622fba tempest-VolumesActionsTest-1233072926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08 /opt/stack/data/cinder/conversion/a48610e8-fc44-472b-834a-d2e155b6be08.temp_image.cd224fb8-2cf4-443c-9dcc-9c4a2ffe328ah9kmx0ff.img" returned: 0 in 4.924s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:47 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e12f12-f016-48d8-a824-f3f314e32932]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-39663b24-2f78-4f88-a99e-7df2be622fba tempest-VolumesActionsTest-1233072926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:47 devstack sudo[101489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08
Jul 03 13:15:47 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:48 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-39663b24-2f78-4f88-a99e-7df2be622fba tempest-VolumesActionsTest-1233072926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08" returned: 0 in 1.012s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:48 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-39663b24-2f78-4f88-a99e-7df2be622fba tempest-VolumesActionsTest-1233072926 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08, size 1024.00 MB, duration 4.93 sec, destination /opt/stack/data/cinder/conversion/a48610e8-fc44-472b-834a-d2e155b6be08.temp_image.cd224fb8-2cf4-443c-9dcc-9c4a2ffe328ah9kmx0ff.img {{(pid=86837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 13:15:48 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-39663b24-2f78-4f88-a99e-7df2be622fba tempest-VolumesActionsTest-1233072926 None] Converted 1024.00 MB image at 207.90 MB/s
Jul 03 13:15:48 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-39663b24-2f78-4f88-a99e-7df2be622fba tempest-VolumesActionsTest-1233072926 None] cd224fb8-2cf4-443c-9dcc-9c4a2ffe328a was raw, converting to qcow2 {{(pid=86837) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jul 03 13:15:48 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacb925b-4873-48e5-9dca-adcb8c0d52e2]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-39663b24-2f78-4f88-a99e-7df2be622fba tempest-VolumesActionsTest-1233072926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a48610e8-fc44-472b-834a-d2e155b6be08.temp_image.cd224fb8-2cf4-443c-9dcc-9c4a2ffe328ah9kmx0ff.img {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:48 devstack sudo[101494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a48610e8-fc44-472b-834a-d2e155b6be08.temp_image.cd224fb8-2cf4-443c-9dcc-9c4a2ffe328ah9kmx0ff.img
Jul 03 13:15:48 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:48 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-39663b24-2f78-4f88-a99e-7df2be622fba tempest-VolumesActionsTest-1233072926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a48610e8-fc44-472b-834a-d2e155b6be08.temp_image.cd224fb8-2cf4-443c-9dcc-9c4a2ffe328ah9kmx0ff.img" returned: 0 in 0.747s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-39663b24-2f78-4f88-a99e-7df2be622fba tempest-VolumesActionsTest-1233072926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a48610e8-fc44-472b-834a-d2e155b6be08.temp_image.cd224fb8-2cf4-443c-9dcc-9c4a2ffe328ah9kmx0ff.img {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:49 devstack sudo[101498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a48610e8-fc44-472b-834a-d2e155b6be08.temp_image.cd224fb8-2cf4-443c-9dcc-9c4a2ffe328ah9kmx0ff.img
Jul 03 13:15:49 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:49 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-39663b24-2f78-4f88-a99e-7df2be622fba tempest-VolumesActionsTest-1233072926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a48610e8-fc44-472b-834a-d2e155b6be08.temp_image.cd224fb8-2cf4-443c-9dcc-9c4a2ffe328ah9kmx0ff.img" returned: 1 in 0.743s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-39663b24-2f78-4f88-a99e-7df2be622fba tempest-VolumesActionsTest-1233072926 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a48610e8-fc44-472b-834a-d2e155b6be08.temp_image.cd224fb8-2cf4-443c-9dcc-9c4a2ffe328ah9kmx0ff.img' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:15:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-39663b24-2f78-4f88-a99e-7df2be622fba tempest-VolumesActionsTest-1233072926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a48610e8-fc44-472b-834a-d2e155b6be08.temp_image.cd224fb8-2cf4-443c-9dcc-9c4a2ffe328ah9kmx0ff.img /opt/stack/data/cinder/conversion/vol_upload__itdoip6 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:49 devstack sudo[101503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a48610e8-fc44-472b-834a-d2e155b6be08.temp_image.cd224fb8-2cf4-443c-9dcc-9c4a2ffe328ah9kmx0ff.img /opt/stack/data/cinder/conversion/vol_upload__itdoip6
Jul 03 13:15:49 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:50 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-39663b24-2f78-4f88-a99e-7df2be622fba tempest-VolumesActionsTest-1233072926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a48610e8-fc44-472b-834a-d2e155b6be08.temp_image.cd224fb8-2cf4-443c-9dcc-9c4a2ffe328ah9kmx0ff.img /opt/stack/data/cinder/conversion/vol_upload__itdoip6" returned: 0 in 0.753s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:50 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-39663b24-2f78-4f88-a99e-7df2be622fba tempest-VolumesActionsTest-1233072926 None] Image conversion details: src /opt/stack/data/cinder/conversion/a48610e8-fc44-472b-834a-d2e155b6be08.temp_image.cd224fb8-2cf4-443c-9dcc-9c4a2ffe328ah9kmx0ff.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload__itdoip6 {{(pid=86837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 13:15:50 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-39663b24-2f78-4f88-a99e-7df2be622fba tempest-VolumesActionsTest-1233072926 None] Converted 1024.00 MB image at 1024.00 MB/s
Jul 03 13:15:50 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b2bbc7-dcc6-43f4-9746-e1468214964e]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-39663b24-2f78-4f88-a99e-7df2be622fba tempest-VolumesActionsTest-1233072926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__itdoip6 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:50 devstack sudo[101508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__itdoip6
Jul 03 13:15:50 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:51 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-39663b24-2f78-4f88-a99e-7df2be622fba tempest-VolumesActionsTest-1233072926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__itdoip6" returned: 0 in 0.829s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:51 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:UPDATE=30,cinder:SELECT=15,cinder:DELETE=2,cinder:INSERT=4 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:15:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-39663b24-2f78-4f88-a99e-7df2be622fba tempest-VolumesActionsTest-1233072926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.197s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-39663b24-2f78-4f88-a99e-7df2be622fba tempest-VolumesActionsTest-1233072926 None] Uploaded volume to glance image-id: cd224fb8-2cf4-443c-9dcc-9c4a2ffe328a. {{(pid=86837) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 03 13:15:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.938s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-38329693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c1bc22-d0e2-40e0-bfe2-73f8b6358df8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='487e2b50c3ab49d08c8282b6a919c127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:15:40Z,use_quota=True,user_id='4dc071788e874546a9bb14e00e9ded46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:15:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Creating volume 70c1bc22-d0e2-40e0-bfe2-73f8b6358df8 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:15:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:15:52 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:15:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-70c1bc22-d0e2-40e0-bfe2-73f8b6358df8 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:52 devstack sudo[101513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-70c1bc22-d0e2-40e0-bfe2-73f8b6358df8 1073741824
Jul 03 13:15:52 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:52 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-39663b24-2f78-4f88-a99e-7df2be622fba tempest-VolumesActionsTest-1233072926 None] Copy volume to image completed successfully.
Jul 03 13:15:53 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-70c1bc22-d0e2-40e0-bfe2-73f8b6358df8 1073741824" returned: 0 in 0.852s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-70c1bc22-d0e2-40e0-bfe2-73f8b6358df8 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:53 devstack sudo[101519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-70c1bc22-d0e2-40e0-bfe2-73f8b6358df8
Jul 03 13:15:53 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:53 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-07841742-7a09-4ebf-abed-9fb57656ebfd tempest-VolumesActionsTest-1233072926 None] Acquiring lock "cinder-a48610e8-fc44-472b-834a-d2e155b6be08-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:53 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-07841742-7a09-4ebf-abed-9fb57656ebfd tempest-VolumesActionsTest-1233072926 None] Lock "cinder-a48610e8-fc44-472b-834a-d2e155b6be08-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:53 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-07841742-7a09-4ebf-abed-9fb57656ebfd tempest-VolumesActionsTest-1233072926 None] Acquiring lock "cinder-quobyte-a48610e8-fc44-472b-834a-d2e155b6be08" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:15:53 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-07841742-7a09-4ebf-abed-9fb57656ebfd tempest-VolumesActionsTest-1233072926 None] Lock "cinder-quobyte-a48610e8-fc44-472b-834a-d2e155b6be08" acquired by "delete_volume" :: waited 0.019s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:15:54 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6f54d2-d127-4208-8af7-89235c5cb5d4]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-07841742-7a09-4ebf-abed-9fb57656ebfd tempest-VolumesActionsTest-1233072926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:54 devstack sudo[101521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08
Jul 03 13:15:54 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:54 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-70c1bc22-d0e2-40e0-bfe2-73f8b6358df8" returned: 0 in 0.703s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:54 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:15:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ce6027ff-c27b-457a-a218-7b35fb831c97 tempest-VolumeDependencyTests-1186088160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.016s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1487b1e3-bca8-4f5f-96a9-fdb02fe79777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70c1bc22-d0e2-40e0-bfe2-73f8b6358df8', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d600dbd-4dbc-4232-b1d0-8ecdf592f676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:54 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-ce6027ff-c27b-457a-a218-7b35fb831c97 tempest-VolumeDependencyTests-1186088160 None] Creating offline snapshot 924f06d9-343f-4ad2-a5f6-f1056a50d85d of volume 66f661da-eb9a-4484-b1ed-7f7ac8706d93 {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:15:54 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Volume volume-70c1bc22-d0e2-40e0-bfe2-73f8b6358df8 (70c1bc22-d0e2-40e0-bfe2-73f8b6358df8): created successfully
Jul 03 13:15:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d600dbd-4dbc-4232-b1d0-8ecdf592f676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Flow 'volume_create_manager' (18657118-9f39-492a-8899-d03677d5d057) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:15:54 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c425b5b-3444-4662-bc8d-9da58935b946]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:15:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ce6027ff-c27b-457a-a218-7b35fb831c97 tempest-VolumeDependencyTests-1186088160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:54 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-57fb0499-285a-4d42-8f88-635cbb790bf7 tempest-VolumesListTestJSON-1589415074 None] Created volume successfully.
Jul 03 13:15:54 devstack sudo[101524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93
Jul 03 13:15:54 devstack sudo[101524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:54 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-07841742-7a09-4ebf-abed-9fb57656ebfd tempest-VolumesActionsTest-1233072926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08" returned: 0 in 0.788s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-07841742-7a09-4ebf-abed-9fb57656ebfd tempest-VolumesActionsTest-1233072926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:54 devstack sudo[101529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08
Jul 03 13:15:54 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:55 devstack sudo[101524]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ce6027ff-c27b-457a-a218-7b35fb831c97 tempest-VolumeDependencyTests-1186088160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93" returned: 0 in 0.801s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ce6027ff-c27b-457a-a218-7b35fb831c97 tempest-VolumeDependencyTests-1186088160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.924f06d9-343f-4ad2-a5f6-f1056a50d85d 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:55 devstack sudo[101535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.924f06d9-343f-4ad2-a5f6-f1056a50d85d 1G
Jul 03 13:15:55 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:55 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-07841742-7a09-4ebf-abed-9fb57656ebfd tempest-VolumesActionsTest-1233072926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a48610e8-fc44-472b-834a-d2e155b6be08" returned: 0 in 0.791s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-07841742-7a09-4ebf-abed-9fb57656ebfd tempest-VolumesActionsTest-1233072926 None] Lock "cinder-quobyte-a48610e8-fc44-472b-834a-d2e155b6be08" released by "delete_volume" :: held 1.621s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:55 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:15:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Flow 'volume_create_manager' (641e4408-24d1-4835-976f-5b92743b1a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:15:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a508648-b260-4c2c-8f11-f864dbffd25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a508648-b260-4c2c-8f11-f864dbffd25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-829919805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c56d125a-6e24-4829-a41b-b3cf73872167,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='487e2b50c3ab49d08c8282b6a919c127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:15:56Z,use_quota=True,user_id='4dc071788e874546a9bb14e00e9ded46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9601a69-c025-4db3-b287-5158b989c62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9601a69-c025-4db3-b287-5158b989c62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1629d73-ce05-43a5-ac9f-da825a1c9b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1629d73-ce05-43a5-ac9f-da825a1c9b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c56d125a-6e24-4829-a41b-b3cf73872167', 'volume_name': 'volume-c56d125a-6e24-4829-a41b-b3cf73872167', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359b32f5-21f0-442a-bcd3-70de39c88bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359b32f5-21f0-442a-bcd3-70de39c88bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:15:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30063189-2dae-4e46-8188-1bf28c19739c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:15:55 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Volume c56d125a-6e24-4829-a41b-b3cf73872167: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c56d125a-6e24-4829-a41b-b3cf73872167', 'volume_size': 1}
Jul 03 13:15:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:55 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-07841742-7a09-4ebf-abed-9fb57656ebfd tempest-VolumesActionsTest-1233072926 None] Created reservations ['9fc4d9db-4d55-4592-960e-6c9beccffa81', '758fa81e-69c6-4ade-98b7-a9285f689644', 'ee2981df-51e5-48d2-8924-3bb986e2c19e', 'a9f4b0f6-098d-4409-a25c-1acd9f22fb0f'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:15:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-07841742-7a09-4ebf-abed-9fb57656ebfd tempest-VolumesActionsTest-1233072926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-07841742-7a09-4ebf-abed-9fb57656ebfd tempest-VolumesActionsTest-1233072926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:55 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-07841742-7a09-4ebf-abed-9fb57656ebfd tempest-VolumesActionsTest-1233072926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:55 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-07841742-7a09-4ebf-abed-9fb57656ebfd tempest-VolumesActionsTest-1233072926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-07841742-7a09-4ebf-abed-9fb57656ebfd tempest-VolumesActionsTest-1233072926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-07841742-7a09-4ebf-abed-9fb57656ebfd tempest-VolumesActionsTest-1233072926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:55 devstack sudo[101540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:15:55 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:56 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ce6027ff-c27b-457a-a218-7b35fb831c97 tempest-VolumeDependencyTests-1186088160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.924f06d9-343f-4ad2-a5f6-f1056a50d85d 1G" returned: 0 in 0.954s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ce6027ff-c27b-457a-a218-7b35fb831c97 tempest-VolumeDependencyTests-1186088160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.924f06d9-343f-4ad2-a5f6-f1056a50d85d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:56 devstack sudo[101546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.924f06d9-343f-4ad2-a5f6-f1056a50d85d
Jul 03 13:15:56 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:56 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-07841742-7a09-4ebf-abed-9fb57656ebfd tempest-VolumesActionsTest-1233072926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.743s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:56 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-07841742-7a09-4ebf-abed-9fb57656ebfd tempest-VolumesActionsTest-1233072926 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:15:56 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-07841742-7a09-4ebf-abed-9fb57656ebfd tempest-VolumesActionsTest-1233072926 None] Deleted volume successfully.
Jul 03 13:15:56 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-07841742-7a09-4ebf-abed-9fb57656ebfd tempest-VolumesActionsTest-1233072926 None] Lock "cinder-a48610e8-fc44-472b-834a-d2e155b6be08-delete_volume" released by "delete_volume" :: held 2.729s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:15:57 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ce6027ff-c27b-457a-a218-7b35fb831c97 tempest-VolumeDependencyTests-1186088160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.924f06d9-343f-4ad2-a5f6-f1056a50d85d" returned: 0 in 0.782s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:57 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-ce6027ff-c27b-457a-a218-7b35fb831c97 tempest-VolumeDependencyTests-1186088160 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.924f06d9-343f-4ad2-a5f6-f1056a50d85d is being set with open permissions: ugo+rw
Jul 03 13:15:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ce6027ff-c27b-457a-a218-7b35fb831c97 tempest-VolumeDependencyTests-1186088160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.924f06d9-343f-4ad2-a5f6-f1056a50d85d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:57 devstack sudo[101553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.924f06d9-343f-4ad2-a5f6-f1056a50d85d
Jul 03 13:15:57 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:57 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ce6027ff-c27b-457a-a218-7b35fb831c97 tempest-VolumeDependencyTests-1186088160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.924f06d9-343f-4ad2-a5f6-f1056a50d85d" returned: 0 in 0.854s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ce6027ff-c27b-457a-a218-7b35fb831c97 tempest-VolumeDependencyTests-1186088160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:57 devstack sudo[101558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.info
Jul 03 13:15:57 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:58 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ce6027ff-c27b-457a-a218-7b35fb831c97 tempest-VolumeDependencyTests-1186088160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.info" returned: 0 in 0.696s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:58 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-ce6027ff-c27b-457a-a218-7b35fb831c97 tempest-VolumeDependencyTests-1186088160 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.info is being set with open permissions: ugo+rw
Jul 03 13:15:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ce6027ff-c27b-457a-a218-7b35fb831c97 tempest-VolumeDependencyTests-1186088160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:58 devstack sudo[101561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.info
Jul 03 13:15:58 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:15:59 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root
Jul 03 13:15:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ce6027ff-c27b-457a-a218-7b35fb831c97 tempest-VolumeDependencyTests-1186088160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.info" returned: 0 in 0.736s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:15:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ce6027ff-c27b-457a-a218-7b35fb831c97 tempest-VolumeDependencyTests-1186088160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.992s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.668s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-829919805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c56d125a-6e24-4829-a41b-b3cf73872167,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='487e2b50c3ab49d08c8282b6a919c127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:15:56Z,use_quota=True,user_id='4dc071788e874546a9bb14e00e9ded46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:15:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Creating volume c56d125a-6e24-4829-a41b-b3cf73872167 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:15:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:15:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:15:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:15:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:15:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:15:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:15:59 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:15:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c56d125a-6e24-4829-a41b-b3cf73872167 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:15:59 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-ce6027ff-c27b-457a-a218-7b35fb831c97 tempest-VolumeDependencyTests-1186088160 None] Create snapshot completed successfully
Jul 03 13:15:59 devstack sudo[101564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c56d125a-6e24-4829-a41b-b3cf73872167 1073741824
Jul 03 13:15:59 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:00 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c56d125a-6e24-4829-a41b-b3cf73872167 1073741824" returned: 0 in 1.012s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c56d125a-6e24-4829-a41b-b3cf73872167 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:00 devstack sudo[101573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c56d125a-6e24-4829-a41b-b3cf73872167
Jul 03 13:16:00 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Flow 'volume_create_manager' (f85dc6a6-686a-4f8f-8815-0e24f621d441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae7c691-b09f-42fa-8b6d-c10fbb30a9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:01 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae7c691-b09f-42fa-8b6d-c10fbb30a9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1494943718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f74f269-e5f1-4568-bc8a-934ca5c09c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f909f245dab945a2ba9d7f62cea59765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=924f06d9-343f-4ad2-a5f6-f1056a50d85d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:16:01Z,use_quota=True,user_id='67894a1f41744532839b53cb023e2a71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5f68df1-fd5a-4c29-b5bc-d044f2e6b0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5f68df1-fd5a-4c29-b5bc-d044f2e6b0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489e5077-20e8-49c9-92e5-4b7804064891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489e5077-20e8-49c9-92e5-4b7804064891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7f74f269-e5f1-4568-bc8a-934ca5c09c84', 'volume_name': 'volume-7f74f269-e5f1-4568-bc8a-934ca5c09c84', 'volume_size': 1, 'snapshot_id': '924f06d9-343f-4ad2-a5f6-f1056a50d85d'}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b0c1ae1-849d-46d0-ade5-8695257a628e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b0c1ae1-849d-46d0-ade5-8695257a628e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c1ec835-54d5-4e1c-8fa2-4156dc992912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:01 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Volume 7f74f269-e5f1-4568-bc8a-934ca5c09c84: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7f74f269-e5f1-4568-bc8a-934ca5c09c84', 'volume_size': 1, 'snapshot_id': '924f06d9-343f-4ad2-a5f6-f1056a50d85d'}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c56d125a-6e24-4829-a41b-b3cf73872167" returned: 0 in 0.882s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] <== create_volume: return (1985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.989s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Acquiring lock "cinder-quobyte-924f06d9-343f-4ad2-a5f6-f1056a50d85d-7f74f269-e5f1-4568-bc8a-934ca5c09c84" by "_create_volume_from_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30063189-2dae-4e46-8188-1bf28c19739c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c56d125a-6e24-4829-a41b-b3cf73872167', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7425a634-aa76-4737-8f4d-4bf0b1204cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Lock "cinder-quobyte-924f06d9-343f-4ad2-a5f6-f1056a50d85d-7f74f269-e5f1-4568-bc8a-934ca5c09c84" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Creating volume 7f74f269-e5f1-4568-bc8a-934ca5c09c84 from snapshot 924f06d9-343f-4ad2-a5f6-f1056a50d85d {{(pid=86837) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Acquiring lock "cinder-quobyte-7f74f269-e5f1-4568-bc8a-934ca5c09c84" by "_copy_volume_from_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:01 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Volume volume-c56d125a-6e24-4829-a41b-b3cf73872167 (c56d125a-6e24-4829-a41b-b3cf73872167): created successfully
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7425a634-aa76-4737-8f4d-4bf0b1204cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Flow 'volume_create_manager' (641e4408-24d1-4835-976f-5b92743b1a3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Lock "cinder-quobyte-7f74f269-e5f1-4568-bc8a-934ca5c09c84" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] snapshot: 924f06d9-343f-4ad2-a5f6-f1056a50d85d, volume: 7f74f269-e5f1-4568-bc8a-934ca5c09c84,  {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 13:16:01 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-f44c0614-83e3-49d3-9622-0d9e5e1ea7cb tempest-VolumesListTestJSON-1589415074 None] Created volume successfully.
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ade97d-4427-4140-87ee-e1d563de8700]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.924f06d9-343f-4ad2-a5f6-f1056a50d85d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:01 devstack sudo[101576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.924f06d9-343f-4ad2-a5f6-f1056a50d85d
Jul 03 13:16:01 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:02 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.924f06d9-343f-4ad2-a5f6-f1056a50d85d" returned: 0 in 0.867s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:16:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93 {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 13:16:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Creating direct copy from snapshot {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 13:16:02 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[020dd049-69a6-4345-a383-9c2f0bb39245]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:02 devstack sudo[101582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93
Jul 03 13:16:02 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:03 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93" returned: 0 in 0.909s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:03 devstack cinder-volume[86837]: DEBUG cinder.utils [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Path /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7f74f269-e5f1-4568-bc8a-934ca5c09c84 not found in is_blk_device check {{(pid=86837) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 13:16:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7f74f269-e5f1-4568-bc8a-934ca5c09c84 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:03 devstack sudo[101588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7f74f269-e5f1-4568-bc8a-934ca5c09c84
Jul 03 13:16:03 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-eca56a0c-9f56-4032-bb8a-a5728e5255a8 tempest-VolumesListTestJSON-1589415074 None] Acquiring lock "cinder-c56d125a-6e24-4829-a41b-b3cf73872167-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-eca56a0c-9f56-4032-bb8a-a5728e5255a8 tempest-VolumesListTestJSON-1589415074 None] Lock "cinder-c56d125a-6e24-4829-a41b-b3cf73872167-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-eca56a0c-9f56-4032-bb8a-a5728e5255a8 tempest-VolumesListTestJSON-1589415074 None] Acquiring lock "cinder-quobyte-c56d125a-6e24-4829-a41b-b3cf73872167" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:05 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-eca56a0c-9f56-4032-bb8a-a5728e5255a8 tempest-VolumesListTestJSON-1589415074 None] Lock "cinder-quobyte-c56d125a-6e24-4829-a41b-b3cf73872167" acquired by "delete_volume" :: waited 0.037s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:05 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b582657-d518-4c26-9b2a-663e69002929]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-eca56a0c-9f56-4032-bb8a-a5728e5255a8 tempest-VolumesListTestJSON-1589415074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c56d125a-6e24-4829-a41b-b3cf73872167 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:05 devstack sudo[101601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c56d125a-6e24-4829-a41b-b3cf73872167
Jul 03 13:16:05 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:06 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-eca56a0c-9f56-4032-bb8a-a5728e5255a8 tempest-VolumesListTestJSON-1589415074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c56d125a-6e24-4829-a41b-b3cf73872167" returned: 0 in 1.504s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-eca56a0c-9f56-4032-bb8a-a5728e5255a8 tempest-VolumesListTestJSON-1589415074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c56d125a-6e24-4829-a41b-b3cf73872167 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:06 devstack sudo[101606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c56d125a-6e24-4829-a41b-b3cf73872167
Jul 03 13:16:06 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:08 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-eca56a0c-9f56-4032-bb8a-a5728e5255a8 tempest-VolumesListTestJSON-1589415074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c56d125a-6e24-4829-a41b-b3cf73872167" returned: 0 in 1.439s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-eca56a0c-9f56-4032-bb8a-a5728e5255a8 tempest-VolumesListTestJSON-1589415074 None] Lock "cinder-quobyte-c56d125a-6e24-4829-a41b-b3cf73872167" released by "delete_volume" :: held 3.064s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:08 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-eca56a0c-9f56-4032-bb8a-a5728e5255a8 tempest-VolumesListTestJSON-1589415074 None] Created reservations ['e742cfe9-ea20-4712-9e6b-b7b5d4127535', 'f0a29cc6-70c5-4234-9c45-b83035226e0f', 'bbbd9085-d5f3-4d6e-97c0-465dee038834', '3089434e-688a-4f38-b2c7-f90726c097ba'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:16:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-eca56a0c-9f56-4032-bb8a-a5728e5255a8 tempest-VolumesListTestJSON-1589415074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-eca56a0c-9f56-4032-bb8a-a5728e5255a8 tempest-VolumesListTestJSON-1589415074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-eca56a0c-9f56-4032-bb8a-a5728e5255a8 tempest-VolumesListTestJSON-1589415074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:16:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-eca56a0c-9f56-4032-bb8a-a5728e5255a8 tempest-VolumesListTestJSON-1589415074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:16:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-eca56a0c-9f56-4032-bb8a-a5728e5255a8 tempest-VolumesListTestJSON-1589415074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-eca56a0c-9f56-4032-bb8a-a5728e5255a8 tempest-VolumesListTestJSON-1589415074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:08 devstack sudo[101609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:16:08 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c62f8866-1cf7-4e0a-921a-6233a614dec3 tempest-VolumesListTestJSON-1589415074 None] Acquiring lock "cinder-70c1bc22-d0e2-40e0-bfe2-73f8b6358df8-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c62f8866-1cf7-4e0a-921a-6233a614dec3 tempest-VolumesListTestJSON-1589415074 None] Lock "cinder-70c1bc22-d0e2-40e0-bfe2-73f8b6358df8-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c62f8866-1cf7-4e0a-921a-6233a614dec3 tempest-VolumesListTestJSON-1589415074 None] Acquiring lock "cinder-quobyte-70c1bc22-d0e2-40e0-bfe2-73f8b6358df8" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c62f8866-1cf7-4e0a-921a-6233a614dec3 tempest-VolumesListTestJSON-1589415074 None] Lock "cinder-quobyte-70c1bc22-d0e2-40e0-bfe2-73f8b6358df8" acquired by "delete_volume" :: waited 0.065s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:09 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7249f2-d1e2-487d-9463-2b14b3ec7c0c]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c62f8866-1cf7-4e0a-921a-6233a614dec3 tempest-VolumesListTestJSON-1589415074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-70c1bc22-d0e2-40e0-bfe2-73f8b6358df8 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:09 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-eca56a0c-9f56-4032-bb8a-a5728e5255a8 tempest-VolumesListTestJSON-1589415074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.165s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:09 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-eca56a0c-9f56-4032-bb8a-a5728e5255a8 tempest-VolumesListTestJSON-1589415074 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:16:09 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-eca56a0c-9f56-4032-bb8a-a5728e5255a8 tempest-VolumesListTestJSON-1589415074 None] Deleted volume successfully.
Jul 03 13:16:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-eca56a0c-9f56-4032-bb8a-a5728e5255a8 tempest-VolumesListTestJSON-1589415074 None] Lock "cinder-c56d125a-6e24-4829-a41b-b3cf73872167-delete_volume" released by "delete_volume" :: held 4.688s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:09 devstack sudo[101612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-70c1bc22-d0e2-40e0-bfe2-73f8b6358df8
Jul 03 13:16:09 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:09 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7f74f269-e5f1-4568-bc8a-934ca5c09c84" returned: 0 in 6.421s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:09 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd410976-0ba3-44a0-b3e8-cb30ecbfdd76]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:09 devstack sudo[101614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93
Jul 03 13:16:09 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:10 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c62f8866-1cf7-4e0a-921a-6233a614dec3 tempest-VolumesListTestJSON-1589415074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-70c1bc22-d0e2-40e0-bfe2-73f8b6358df8" returned: 0 in 1.105s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c62f8866-1cf7-4e0a-921a-6233a614dec3 tempest-VolumesListTestJSON-1589415074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-70c1bc22-d0e2-40e0-bfe2-73f8b6358df8 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:10 devstack sudo[101621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-70c1bc22-d0e2-40e0-bfe2-73f8b6358df8
Jul 03 13:16:10 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:10 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93" returned: 0 in 1.091s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:10 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93, size 1024.00 MB, duration 6.42 sec, destination /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7f74f269-e5f1-4568-bc8a-934ca5c09c84 {{(pid=86837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 13:16:10 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Converted 1024.00 MB image at 159.45 MB/s
Jul 03 13:16:10 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7f74f269-e5f1-4568-bc8a-934ca5c09c84 is being set with open permissions: ugo+rw
Jul 03 13:16:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7f74f269-e5f1-4568-bc8a-934ca5c09c84 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:10 devstack sudo[101624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7f74f269-e5f1-4568-bc8a-934ca5c09c84
Jul 03 13:16:10 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:11 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c62f8866-1cf7-4e0a-921a-6233a614dec3 tempest-VolumesListTestJSON-1589415074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-70c1bc22-d0e2-40e0-bfe2-73f8b6358df8" returned: 0 in 0.807s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:11 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c62f8866-1cf7-4e0a-921a-6233a614dec3 tempest-VolumesListTestJSON-1589415074 None] Lock "cinder-quobyte-70c1bc22-d0e2-40e0-bfe2-73f8b6358df8" released by "delete_volume" :: held 2.045s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:11 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-c62f8866-1cf7-4e0a-921a-6233a614dec3 tempest-VolumesListTestJSON-1589415074 None] Created reservations ['8aeb2c12-3e7e-441f-a1f5-0acc3c28b3dd', '581e7e96-c179-4acc-81a0-a246ccb0b43a', '06df1972-0ae1-408b-a03a-5ed9200b730b', '4259261b-2bd0-4483-ab39-e1525154884b'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:16:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c62f8866-1cf7-4e0a-921a-6233a614dec3 tempest-VolumesListTestJSON-1589415074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c62f8866-1cf7-4e0a-921a-6233a614dec3 tempest-VolumesListTestJSON-1589415074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c62f8866-1cf7-4e0a-921a-6233a614dec3 tempest-VolumesListTestJSON-1589415074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:16:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c62f8866-1cf7-4e0a-921a-6233a614dec3 tempest-VolumesListTestJSON-1589415074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:16:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c62f8866-1cf7-4e0a-921a-6233a614dec3 tempest-VolumesListTestJSON-1589415074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c62f8866-1cf7-4e0a-921a-6233a614dec3 tempest-VolumesListTestJSON-1589415074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:11 devstack sudo[101627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:16:11 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:11 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7f74f269-e5f1-4568-bc8a-934ca5c09c84" returned: 0 in 1.002s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:11 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Lock "cinder-quobyte-7f74f269-e5f1-4568-bc8a-934ca5c09c84" released by "_copy_volume_from_snapshot" :: held 10.403s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:11 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Lock "cinder-quobyte-924f06d9-343f-4ad2-a5f6-f1056a50d85d-7f74f269-e5f1-4568-bc8a-934ca5c09c84" released by "_create_volume_from_snapshot" :: held 10.455s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.488s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c1ec835-54d5-4e1c-8fa2-4156dc992912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f74f269-e5f1-4568-bc8a-934ca5c09c84', 'volume_size': 1, 'snapshot_id': '924f06d9-343f-4ad2-a5f6-f1056a50d85d'}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80d3e8b3-517a-4197-8842-197e39966473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:11 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Volume volume-7f74f269-e5f1-4568-bc8a-934ca5c09c84 (7f74f269-e5f1-4568-bc8a-934ca5c09c84): created successfully
Jul 03 13:16:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80d3e8b3-517a-4197-8842-197e39966473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Flow 'volume_create_manager' (f85dc6a6-686a-4f8f-8815-0e24f621d441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:16:12 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-3f1244bf-3842-48d9-8720-0db2542306a4 tempest-VolumeDependencyTests-1186088160 None] Created volume successfully.
Jul 03 13:16:12 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c62f8866-1cf7-4e0a-921a-6233a614dec3 tempest-VolumesListTestJSON-1589415074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.732s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:12 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-c62f8866-1cf7-4e0a-921a-6233a614dec3 tempest-VolumesListTestJSON-1589415074 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:16:12 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-c62f8866-1cf7-4e0a-921a-6233a614dec3 tempest-VolumesListTestJSON-1589415074 None] Deleted volume successfully.
Jul 03 13:16:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c62f8866-1cf7-4e0a-921a-6233a614dec3 tempest-VolumesListTestJSON-1589415074 None] Lock "cinder-70c1bc22-d0e2-40e0-bfe2-73f8b6358df8-delete_volume" released by "delete_volume" :: held 3.341s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1ba1399f-e99d-4440-a300-7c4d775fd445 tempest-VolumeDependencyTests-1186088160 None] Acquiring lock "cinder-924f06d9-343f-4ad2-a5f6-f1056a50d85d-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1ba1399f-e99d-4440-a300-7c4d775fd445 tempest-VolumeDependencyTests-1186088160 None] Lock "cinder-924f06d9-343f-4ad2-a5f6-f1056a50d85d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1ba1399f-e99d-4440-a300-7c4d775fd445 tempest-VolumeDependencyTests-1186088160 None] Acquiring lock "cinder-quobyte-66f661da-eb9a-4484-b1ed-7f7ac8706d93" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1ba1399f-e99d-4440-a300-7c4d775fd445 tempest-VolumeDependencyTests-1186088160 None] Lock "cinder-quobyte-66f661da-eb9a-4484-b1ed-7f7ac8706d93" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1ba1399f-e99d-4440-a300-7c4d775fd445 tempest-VolumeDependencyTests-1186088160 None] Acquiring lock "cinder-quobyte-924f06d9-343f-4ad2-a5f6-f1056a50d85d" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1ba1399f-e99d-4440-a300-7c4d775fd445 tempest-VolumeDependencyTests-1186088160 None] Lock "cinder-quobyte-924f06d9-343f-4ad2-a5f6-f1056a50d85d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:12 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-1ba1399f-e99d-4440-a300-7c4d775fd445 tempest-VolumeDependencyTests-1186088160 None] Deleting offline snapshot 924f06d9-343f-4ad2-a5f6-f1056a50d85d of volume 66f661da-eb9a-4484-b1ed-7f7ac8706d93 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:16:12 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-1ba1399f-e99d-4440-a300-7c4d775fd445 tempest-VolumeDependencyTests-1186088160 None] snapshot_file for this snap is: volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.924f06d9-343f-4ad2-a5f6-f1056a50d85d {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:16:12 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a25a8dd-6a5a-4ee9-9c9a-624e76c6931a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1ba1399f-e99d-4440-a300-7c4d775fd445 tempest-VolumeDependencyTests-1186088160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.924f06d9-343f-4ad2-a5f6-f1056a50d85d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-94a32438-0378-406a-980e-71da3bc00a49 tempest-VolumesListTestJSON-1589415074 None] Acquiring lock "cinder-ff8fd3ec-94e5-422d-b6f6-79fc6a6cbf8d-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-94a32438-0378-406a-980e-71da3bc00a49 tempest-VolumesListTestJSON-1589415074 None] Lock "cinder-ff8fd3ec-94e5-422d-b6f6-79fc6a6cbf8d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:12 devstack sudo[101631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.924f06d9-343f-4ad2-a5f6-f1056a50d85d
Jul 03 13:16:12 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-94a32438-0378-406a-980e-71da3bc00a49 tempest-VolumesListTestJSON-1589415074 None] Acquiring lock "cinder-quobyte-ff8fd3ec-94e5-422d-b6f6-79fc6a6cbf8d" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-94a32438-0378-406a-980e-71da3bc00a49 tempest-VolumesListTestJSON-1589415074 None] Lock "cinder-quobyte-ff8fd3ec-94e5-422d-b6f6-79fc6a6cbf8d" acquired by "delete_volume" :: waited 0.023s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:13 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b1965e-90f7-49a9-a6eb-16e0d38d7cbe]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-94a32438-0378-406a-980e-71da3bc00a49 tempest-VolumesListTestJSON-1589415074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ff8fd3ec-94e5-422d-b6f6-79fc6a6cbf8d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:13 devstack sudo[101634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ff8fd3ec-94e5-422d-b6f6-79fc6a6cbf8d
Jul 03 13:16:13 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:13 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1ba1399f-e99d-4440-a300-7c4d775fd445 tempest-VolumeDependencyTests-1186088160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.924f06d9-343f-4ad2-a5f6-f1056a50d85d" returned: 0 in 1.090s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:13 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-1ba1399f-e99d-4440-a300-7c4d775fd445 tempest-VolumeDependencyTests-1186088160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:16:13 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[7320a2d1-b241-4041-99ae-8aff55336ac1]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1ba1399f-e99d-4440-a300-7c4d775fd445 tempest-VolumeDependencyTests-1186088160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:14 devstack sudo[101640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93
Jul 03 13:16:14 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:14 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-94a32438-0378-406a-980e-71da3bc00a49 tempest-VolumesListTestJSON-1589415074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ff8fd3ec-94e5-422d-b6f6-79fc6a6cbf8d" returned: 0 in 1.093s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-94a32438-0378-406a-980e-71da3bc00a49 tempest-VolumesListTestJSON-1589415074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ff8fd3ec-94e5-422d-b6f6-79fc6a6cbf8d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:14 devstack sudo[101645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ff8fd3ec-94e5-422d-b6f6-79fc6a6cbf8d
Jul 03 13:16:14 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:14 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1ba1399f-e99d-4440-a300-7c4d775fd445 tempest-VolumeDependencyTests-1186088160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93" returned: 0 in 1.065s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1ba1399f-e99d-4440-a300-7c4d775fd445 tempest-VolumeDependencyTests-1186088160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.924f06d9-343f-4ad2-a5f6-f1056a50d85d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:16:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:16:14 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:14 devstack sudo[101651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.924f06d9-343f-4ad2-a5f6-f1056a50d85d
Jul 03 13:16:14 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:16:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-94a32438-0378-406a-980e-71da3bc00a49 tempest-VolumesListTestJSON-1589415074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ff8fd3ec-94e5-422d-b6f6-79fc6a6cbf8d" returned: 0 in 0.883s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:15 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-94a32438-0378-406a-980e-71da3bc00a49 tempest-VolumesListTestJSON-1589415074 None] Lock "cinder-quobyte-ff8fd3ec-94e5-422d-b6f6-79fc6a6cbf8d" released by "delete_volume" :: held 2.052s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:15 devstack sudo[101653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:16:15 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:15 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-94a32438-0378-406a-980e-71da3bc00a49 tempest-VolumesListTestJSON-1589415074 None] Created reservations ['86ffcc21-6f74-4d86-b730-4d034964afe0', '7ae7df20-5680-4cec-81f1-1f902c6ff11f', '8482399e-4706-4195-8e2b-b3700e0e86f7', '45506857-49f4-4999-8221-bd1a50ab8ea2'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:16:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-94a32438-0378-406a-980e-71da3bc00a49 tempest-VolumesListTestJSON-1589415074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-94a32438-0378-406a-980e-71da3bc00a49 tempest-VolumesListTestJSON-1589415074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:15 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-94a32438-0378-406a-980e-71da3bc00a49 tempest-VolumesListTestJSON-1589415074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:16:15 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-94a32438-0378-406a-980e-71da3bc00a49 tempest-VolumesListTestJSON-1589415074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:16:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-94a32438-0378-406a-980e-71da3bc00a49 tempest-VolumesListTestJSON-1589415074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-94a32438-0378-406a-980e-71da3bc00a49 tempest-VolumesListTestJSON-1589415074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:15 devstack sudo[101655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:16:15 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:15 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.996s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:15 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:16:15 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:16:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 28 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:16:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>, <Thread(tpool_thread_0, started daemon 134850092431040)>, <Thread(tpool_thread_1, started daemon 134850084021952)>, <Thread(tpool_thread_2, started daemon 134850075612864)>, <Thread(tpool_thread_3, started daemon 134850067203776)>, <Thread(tpool_thread_4, started daemon 134850058794688)>, <Thread(tpool_thread_5, started daemon 134850050385600)>, <Thread(tpool_thread_6, started daemon 134850041976512)>, <Thread(tpool_thread_7, started daemon 134850033567424)>, <Thread(tpool_thread_8, started daemon 134850025158336)>, <Thread(tpool_thread_9, started daemon 134850016749248)>, <Thread(tpool_thread_10, started daemon 134850008340160)>, <Thread(tpool_thread_11, started daemon 134849999931072)>, <Thread(tpool_thread_12, started daemon 134849991521984)>, <Thread(tpool_thread_13, started daemon 134849983112896)>, <Thread(tpool_thread_14, started daemon 134849974703808)>, <Thread(tpool_thread_15, started daemon 134849966294720)>, <Thread(tpool_thread_16, started daemon 134849957885632)>, <Thread(tpool_thread_17, started daemon 134849949476544)>, <Thread(tpool_thread_18, started daemon 134849941067456)>, <Thread(tpool_thread_19, started daemon 134849932658368)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:16:16 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1ba1399f-e99d-4440-a300-7c4d775fd445 tempest-VolumeDependencyTests-1186088160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.924f06d9-343f-4ad2-a5f6-f1056a50d85d" returned: 0 in 1.201s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1ba1399f-e99d-4440-a300-7c4d775fd445 tempest-VolumeDependencyTests-1186088160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.924f06d9-343f-4ad2-a5f6-f1056a50d85d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:16 devstack sudo[101662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.924f06d9-343f-4ad2-a5f6-f1056a50d85d
Jul 03 13:16:16 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:16 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-94a32438-0378-406a-980e-71da3bc00a49 tempest-VolumesListTestJSON-1589415074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.270s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:16 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-94a32438-0378-406a-980e-71da3bc00a49 tempest-VolumesListTestJSON-1589415074 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:16:16 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-94a32438-0378-406a-980e-71da3bc00a49 tempest-VolumesListTestJSON-1589415074 None] Deleted volume successfully.
Jul 03 13:16:16 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-94a32438-0378-406a-980e-71da3bc00a49 tempest-VolumesListTestJSON-1589415074 None] Lock "cinder-ff8fd3ec-94e5-422d-b6f6-79fc6a6cbf8d-delete_volume" released by "delete_volume" :: held 3.776s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:17 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1ba1399f-e99d-4440-a300-7c4d775fd445 tempest-VolumeDependencyTests-1186088160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93.924f06d9-343f-4ad2-a5f6-f1056a50d85d" returned: 0 in 0.990s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1ba1399f-e99d-4440-a300-7c4d775fd445 tempest-VolumeDependencyTests-1186088160 None] Lock "cinder-quobyte-924f06d9-343f-4ad2-a5f6-f1056a50d85d" released by "_delete_snapshot" :: held 4.527s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1ba1399f-e99d-4440-a300-7c4d775fd445 tempest-VolumeDependencyTests-1186088160 None] Lock "cinder-quobyte-66f661da-eb9a-4484-b1ed-7f7ac8706d93" released by "delete_snapshot" :: held 4.572s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:17 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-1ba1399f-e99d-4440-a300-7c4d775fd445 tempest-VolumeDependencyTests-1186088160 None] Created reservations ['35bf479d-27ab-42be-8c26-8dfd78acdc6a', '66a897bc-b119-4bd6-87cb-09a795cc511b', '157d9334-1318-404b-93e5-30bc6d57df96', '36bf77ea-b020-48c6-84e7-53250938945f'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:16:17 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-1ba1399f-e99d-4440-a300-7c4d775fd445 tempest-VolumeDependencyTests-1186088160 None] Delete snapshot completed successfully.
Jul 03 13:16:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1ba1399f-e99d-4440-a300-7c4d775fd445 tempest-VolumeDependencyTests-1186088160 None] Lock "cinder-924f06d9-343f-4ad2-a5f6-f1056a50d85d-delete_snapshot" released by "delete_snapshot" :: held 4.820s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:18 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-119d28e9-7938-4629-be01-33e1763abd4a tempest-VolumeDependencyTests-1186088160 None] Acquiring lock "cinder-66f661da-eb9a-4484-b1ed-7f7ac8706d93-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:18 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-119d28e9-7938-4629-be01-33e1763abd4a tempest-VolumeDependencyTests-1186088160 None] Lock "cinder-66f661da-eb9a-4484-b1ed-7f7ac8706d93-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:18 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-119d28e9-7938-4629-be01-33e1763abd4a tempest-VolumeDependencyTests-1186088160 None] Acquiring lock "cinder-quobyte-66f661da-eb9a-4484-b1ed-7f7ac8706d93" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:18 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-119d28e9-7938-4629-be01-33e1763abd4a tempest-VolumeDependencyTests-1186088160 None] Lock "cinder-quobyte-66f661da-eb9a-4484-b1ed-7f7ac8706d93" acquired by "delete_volume" :: waited 0.030s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:18 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e45941c-b1ed-4caf-821e-ef3ee5e86f7f]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-119d28e9-7938-4629-be01-33e1763abd4a tempest-VolumeDependencyTests-1186088160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:18 devstack sudo[101666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93
Jul 03 13:16:18 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:19 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-119d28e9-7938-4629-be01-33e1763abd4a tempest-VolumeDependencyTests-1186088160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93" returned: 0 in 0.903s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-119d28e9-7938-4629-be01-33e1763abd4a tempest-VolumeDependencyTests-1186088160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:19 devstack sudo[101671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93
Jul 03 13:16:19 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:20 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-119d28e9-7938-4629-be01-33e1763abd4a tempest-VolumeDependencyTests-1186088160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-66f661da-eb9a-4484-b1ed-7f7ac8706d93" returned: 0 in 0.874s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-119d28e9-7938-4629-be01-33e1763abd4a tempest-VolumeDependencyTests-1186088160 None] Lock "cinder-quobyte-66f661da-eb9a-4484-b1ed-7f7ac8706d93" released by "delete_volume" :: held 1.879s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:20 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-119d28e9-7938-4629-be01-33e1763abd4a tempest-VolumeDependencyTests-1186088160 None] Created reservations ['34199d66-3ee7-4fb6-827c-54932d44f5d8', 'c5070650-9c03-45b9-993a-88fda1d217ca', '8c2ebbd0-15b3-45c7-be12-17ffe708deb5', '650036e9-2dfa-4988-b4b7-37fb082a1b42'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:16:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-119d28e9-7938-4629-be01-33e1763abd4a tempest-VolumeDependencyTests-1186088160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-119d28e9-7938-4629-be01-33e1763abd4a tempest-VolumeDependencyTests-1186088160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:20 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-119d28e9-7938-4629-be01-33e1763abd4a tempest-VolumeDependencyTests-1186088160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:16:20 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-119d28e9-7938-4629-be01-33e1763abd4a tempest-VolumeDependencyTests-1186088160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:16:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-119d28e9-7938-4629-be01-33e1763abd4a tempest-VolumeDependencyTests-1186088160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-119d28e9-7938-4629-be01-33e1763abd4a tempest-VolumeDependencyTests-1186088160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:20 devstack sudo[101674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:16:20 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-beb9cd4a-6784-4d05-b430-09a11ed746d9 tempest-VolumeDependencyTests-1186088160 None] Acquiring lock "cinder-7f74f269-e5f1-4568-bc8a-934ca5c09c84-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-beb9cd4a-6784-4d05-b430-09a11ed746d9 tempest-VolumeDependencyTests-1186088160 None] Lock "cinder-7f74f269-e5f1-4568-bc8a-934ca5c09c84-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-beb9cd4a-6784-4d05-b430-09a11ed746d9 tempest-VolumeDependencyTests-1186088160 None] Acquiring lock "cinder-quobyte-7f74f269-e5f1-4568-bc8a-934ca5c09c84" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-beb9cd4a-6784-4d05-b430-09a11ed746d9 tempest-VolumeDependencyTests-1186088160 None] Lock "cinder-quobyte-7f74f269-e5f1-4568-bc8a-934ca5c09c84" acquired by "delete_volume" :: waited 0.034s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:20 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2deb9da-a888-4053-ba1f-4c811afcf8d7]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-beb9cd4a-6784-4d05-b430-09a11ed746d9 tempest-VolumeDependencyTests-1186088160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7f74f269-e5f1-4568-bc8a-934ca5c09c84 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:20 devstack sudo[101676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7f74f269-e5f1-4568-bc8a-934ca5c09c84
Jul 03 13:16:20 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:20 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:16:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Flow 'volume_create_manager' (ed49bc4b-9217-45b3-af2a-30ee718fdee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:16:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ec291a-d8a0-4201-b956-b126f2d1e4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ec291a-d8a0-4201-b956-b126f2d1e4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1954303304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c48e8b-7e69-4134-ae47-e1b040b4dd71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='906ec596413e47128de2f8a4e6385fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:16:21Z,use_quota=True,user_id='4413bd5de2bd4d6ba1f458f12ecf72de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d31380e-fa5b-4f96-a608-1817b29b8946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d31380e-fa5b-4f96-a608-1817b29b8946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ea6b57-7b3e-41ea-8232-f183e9848972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ea6b57-7b3e-41ea-8232-f183e9848972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99c48e8b-7e69-4134-ae47-e1b040b4dd71', 'volume_name': 'volume-99c48e8b-7e69-4134-ae47-e1b040b4dd71', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a837f79a-a843-4dc5-947c-2fc026dc1100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a837f79a-a843-4dc5-947c-2fc026dc1100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4abd173e-da87-41ba-8010-565361f554bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:21 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Volume 99c48e8b-7e69-4134-ae47-e1b040b4dd71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99c48e8b-7e69-4134-ae47-e1b040b4dd71', 'volume_size': 1}
Jul 03 13:16:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:21 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1954303304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c48e8b-7e69-4134-ae47-e1b040b4dd71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='906ec596413e47128de2f8a4e6385fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:16:21Z,use_quota=True,user_id='4413bd5de2bd4d6ba1f458f12ecf72de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:16:21 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Creating volume 99c48e8b-7e69-4134-ae47-e1b040b4dd71 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:16:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:21 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:16:21 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:16:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:21 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:16:21 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:16:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-99c48e8b-7e69-4134-ae47-e1b040b4dd71 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:21 devstack sudo[101712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-99c48e8b-7e69-4134-ae47-e1b040b4dd71 1073741824
Jul 03 13:16:21 devstack sudo[101712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:21 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-119d28e9-7938-4629-be01-33e1763abd4a tempest-VolumeDependencyTests-1186088160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.048s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:21 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-119d28e9-7938-4629-be01-33e1763abd4a tempest-VolumeDependencyTests-1186088160 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:16:21 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-119d28e9-7938-4629-be01-33e1763abd4a tempest-VolumeDependencyTests-1186088160 None] Deleted volume successfully.
Jul 03 13:16:21 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-119d28e9-7938-4629-be01-33e1763abd4a tempest-VolumeDependencyTests-1186088160 None] Lock "cinder-66f661da-eb9a-4484-b1ed-7f7ac8706d93-delete_volume" released by "delete_volume" :: held 3.301s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:21 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-beb9cd4a-6784-4d05-b430-09a11ed746d9 tempest-VolumeDependencyTests-1186088160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7f74f269-e5f1-4568-bc8a-934ca5c09c84" returned: 0 in 1.295s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-beb9cd4a-6784-4d05-b430-09a11ed746d9 tempest-VolumeDependencyTests-1186088160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7f74f269-e5f1-4568-bc8a-934ca5c09c84 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:21 devstack sudo[101723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7f74f269-e5f1-4568-bc8a-934ca5c09c84
Jul 03 13:16:21 devstack sudo[101723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:22 devstack sudo[101712]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-99c48e8b-7e69-4134-ae47-e1b040b4dd71 1073741824" returned: 0 in 1.268s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:22 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=71,cinder:INSERT=22,cinder:UPDATE=91,cinder:DELETE=7 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:16:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-99c48e8b-7e69-4134-ae47-e1b040b4dd71 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:22 devstack sudo[101726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-99c48e8b-7e69-4134-ae47-e1b040b4dd71
Jul 03 13:16:22 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:22 devstack sudo[101723]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-beb9cd4a-6784-4d05-b430-09a11ed746d9 tempest-VolumeDependencyTests-1186088160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7f74f269-e5f1-4568-bc8a-934ca5c09c84" returned: 0 in 0.903s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:22 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-beb9cd4a-6784-4d05-b430-09a11ed746d9 tempest-VolumeDependencyTests-1186088160 None] Lock "cinder-quobyte-7f74f269-e5f1-4568-bc8a-934ca5c09c84" released by "delete_volume" :: held 2.293s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:22 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-beb9cd4a-6784-4d05-b430-09a11ed746d9 tempest-VolumeDependencyTests-1186088160 None] Created reservations ['6a17256b-2e53-4e94-abb1-c8cf8b95a134', '0083be2f-9c0e-4191-b6c1-edc13d60ed71', '6801e143-b7b9-4822-a1bc-50c873e37b6e', 'e74a608c-3f28-497f-8765-841b864058d6'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:16:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-beb9cd4a-6784-4d05-b430-09a11ed746d9 tempest-VolumeDependencyTests-1186088160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-beb9cd4a-6784-4d05-b430-09a11ed746d9 tempest-VolumeDependencyTests-1186088160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-beb9cd4a-6784-4d05-b430-09a11ed746d9 tempest-VolumeDependencyTests-1186088160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:16:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-beb9cd4a-6784-4d05-b430-09a11ed746d9 tempest-VolumeDependencyTests-1186088160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:16:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-beb9cd4a-6784-4d05-b430-09a11ed746d9 tempest-VolumeDependencyTests-1186088160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-beb9cd4a-6784-4d05-b430-09a11ed746d9 tempest-VolumeDependencyTests-1186088160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:23 devstack sudo[101736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:16:23 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:23 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-99c48e8b-7e69-4134-ae47-e1b040b4dd71" returned: 0 in 0.910s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] <== create_volume: return (2246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:16:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.249s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4abd173e-da87-41ba-8010-565361f554bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99c48e8b-7e69-4134-ae47-e1b040b4dd71', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7cf7bd-dbd7-427b-aa6f-c60d57cc0eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:23 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Volume volume-99c48e8b-7e69-4134-ae47-e1b040b4dd71 (99c48e8b-7e69-4134-ae47-e1b040b4dd71): created successfully
Jul 03 13:16:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7cf7bd-dbd7-427b-aa6f-c60d57cc0eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Flow 'volume_create_manager' (ed49bc4b-9217-45b3-af2a-30ee718fdee8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:16:23 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-9d9c8292-703f-402d-b469-fc9a35d9702d tempest-VolumesNegativeTest-878032950 None] Created volume successfully.
Jul 03 13:16:24 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-beb9cd4a-6784-4d05-b430-09a11ed746d9 tempest-VolumeDependencyTests-1186088160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.032s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:24 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-beb9cd4a-6784-4d05-b430-09a11ed746d9 tempest-VolumeDependencyTests-1186088160 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:16:24 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-beb9cd4a-6784-4d05-b430-09a11ed746d9 tempest-VolumeDependencyTests-1186088160 None] Deleted volume successfully.
Jul 03 13:16:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-beb9cd4a-6784-4d05-b430-09a11ed746d9 tempest-VolumeDependencyTests-1186088160 None] Lock "cinder-7f74f269-e5f1-4568-bc8a-934ca5c09c84-delete_volume" released by "delete_volume" :: held 3.673s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:29 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:16:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Flow 'volume_create_manager' (747ca93b-cd34-4144-8b5b-de12a077a6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:16:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10c11b6-db35-45b8-8bc8-337cf3c5cb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10c11b6-db35-45b8-8bc8-337cf3c5cb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b938d8d-1568-48d3-b057-be1970d7db85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e4b106e6c549118fac5c2141ea953c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:16:30Z,use_quota=True,user_id='858e52cfe2314148a6725aa6e3d91eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02ccb09-8b2b-45bb-a58a-92311bfe06b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02ccb09-8b2b-45bb-a58a-92311bfe06b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3289ee80-4e74-4129-8131-32d266d6177a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3289ee80-4e74-4129-8131-32d266d6177a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b938d8d-1568-48d3-b057-be1970d7db85', 'volume_name': 'volume-7b938d8d-1568-48d3-b057-be1970d7db85', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (404507c0-f405-4b9e-bae1-f6b36ebc7935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (404507c0-f405-4b9e-bae1-f6b36ebc7935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010e6f9c-a452-45cf-9291-8ed910f29962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:30 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Volume 7b938d8d-1568-48d3-b057-be1970d7db85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b938d8d-1568-48d3-b057-be1970d7db85', 'volume_size': 1}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b938d8d-1568-48d3-b057-be1970d7db85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e4b106e6c549118fac5c2141ea953c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:16:30Z,use_quota=True,user_id='858e52cfe2314148a6725aa6e3d91eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Creating volume 7b938d8d-1568-48d3-b057-be1970d7db85 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:16:30 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7b938d8d-1568-48d3-b057-be1970d7db85 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:30 devstack sudo[101744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7b938d8d-1568-48d3-b057-be1970d7db85 1073741824
Jul 03 13:16:30 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Flow 'volume_create_manager' (1c2bd294-aa9c-4dbe-a797-03ea79a61cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b68be0d4-ecfd-4637-ad42-23dea38842e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b68be0d4-ecfd-4637-ad42-23dea38842e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1656654919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805a8541-29eb-4d41-8392-d7b94534558b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='014d418a12f949c28580939ead48407b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:16:30Z,use_quota=True,user_id='9854acea47f74aba85cd5c1d824785f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097f8467-4751-4b4b-b4b0-225b678784f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097f8467-4751-4b4b-b4b0-225b678784f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d05e68e7-1a8b-4563-b955-a0edcc7a7d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d05e68e7-1a8b-4563-b955-a0edcc7a7d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '805a8541-29eb-4d41-8392-d7b94534558b', 'volume_name': 'volume-805a8541-29eb-4d41-8392-d7b94534558b', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (191ceaad-1634-46e1-8ce6-01eec036dd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (191ceaad-1634-46e1-8ce6-01eec036dd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298706fa-5e76-4fdb-91eb-ee8f4125b35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:30 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Volume 805a8541-29eb-4d41-8392-d7b94534558b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-805a8541-29eb-4d41-8392-d7b94534558b', 'volume_size': 1}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:30 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:16:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Flow 'volume_create_manager' (f137b333-f42e-4660-ab9f-d54f0be40040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:16:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72337c0a-b29b-461d-9ead-97ec5f65b41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72337c0a-b29b-461d-9ead-97ec5f65b41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2030934401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf677b3-6c16-4bb4-b57a-2e74c1a83af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='014d418a12f949c28580939ead48407b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:16:31Z,use_quota=True,user_id='9854acea47f74aba85cd5c1d824785f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14676c92-44e9-4e07-be69-3b89e3a1f093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14676c92-44e9-4e07-be69-3b89e3a1f093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53305de5-947b-4332-86a4-18b31f51968a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53305de5-947b-4332-86a4-18b31f51968a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cf677b3-6c16-4bb4-b57a-2e74c1a83af7', 'volume_name': 'volume-3cf677b3-6c16-4bb4-b57a-2e74c1a83af7', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3625d0fa-f031-4266-bc2c-e551b1ae4866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3625d0fa-f031-4266-bc2c-e551b1ae4866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e7b825-7b6f-45f5-b1bc-0965c702c505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:31 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Volume 3cf677b3-6c16-4bb4-b57a-2e74c1a83af7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cf677b3-6c16-4bb4-b57a-2e74c1a83af7', 'volume_size': 1}
Jul 03 13:16:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:31 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7b938d8d-1568-48d3-b057-be1970d7db85 1073741824" returned: 0 in 1.342s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7b938d8d-1568-48d3-b057-be1970d7db85 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:31 devstack sudo[101750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7b938d8d-1568-48d3-b057-be1970d7db85
Jul 03 13:16:31 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:32 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7b938d8d-1568-48d3-b057-be1970d7db85" returned: 0 in 0.967s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] <== create_volume: return (2397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:16:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.406s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.938s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1656654919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805a8541-29eb-4d41-8392-d7b94534558b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='014d418a12f949c28580939ead48407b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:16:30Z,use_quota=True,user_id='9854acea47f74aba85cd5c1d824785f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:16:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Creating volume 805a8541-29eb-4d41-8392-d7b94534558b {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:16:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:16:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:16:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:16:32 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:16:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-805a8541-29eb-4d41-8392-d7b94534558b 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010e6f9c-a452-45cf-9291-8ed910f29962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b938d8d-1568-48d3-b057-be1970d7db85', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1eafbfd-822d-4846-a90e-f045fa9dcc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:32 devstack sudo[101757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-805a8541-29eb-4d41-8392-d7b94534558b 1073741824
Jul 03 13:16:32 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:32 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Volume volume-7b938d8d-1568-48d3-b057-be1970d7db85 (7b938d8d-1568-48d3-b057-be1970d7db85): created successfully
Jul 03 13:16:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1eafbfd-822d-4846-a90e-f045fa9dcc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Flow 'volume_create_manager' (747ca93b-cd34-4144-8b5b-de12a077a6fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:16:32 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-310fe244-1222-4063-8ebf-f09e3c18a2e3 tempest-CinderUnicodeTest-410905251 None] Created volume successfully.
Jul 03 13:16:33 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-805a8541-29eb-4d41-8392-d7b94534558b 1073741824" returned: 0 in 1.456s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-805a8541-29eb-4d41-8392-d7b94534558b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:34 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:16:34 devstack sudo[101778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-805a8541-29eb-4d41-8392-d7b94534558b
Jul 03 13:16:34 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Flow 'volume_create_manager' (35feeea6-23ed-430c-950d-9d8d42f23943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:16:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14866eab-4d91-49f5-a233-f35ed5fa7010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14866eab-4d91-49f5-a233-f35ed5fa7010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:16:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1240305742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d758a32d-67e7-47be-b214-5640df9c84be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e4b106e6c549118fac5c2141ea953c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:16:34Z,use_quota=True,user_id='858e52cfe2314148a6725aa6e3d91eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37afb9e4-c24a-422f-ac82-bb2438ed785c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37afb9e4-c24a-422f-ac82-bb2438ed785c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816c7fbe-c10d-4c75-8e55-a918ecf50f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816c7fbe-c10d-4c75-8e55-a918ecf50f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd758a32d-67e7-47be-b214-5640df9c84be', 'volume_name': 'volume-d758a32d-67e7-47be-b214-5640df9c84be', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5ad992c-5642-40e1-b4aa-0fea6869588c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5ad992c-5642-40e1-b4aa-0fea6869588c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79708a68-96d8-4102-81eb-2c43731c7806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:34 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Volume d758a32d-67e7-47be-b214-5640df9c84be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d758a32d-67e7-47be-b214-5640df9c84be', 'volume_size': 1}
Jul 03 13:16:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:34 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-805a8541-29eb-4d41-8392-d7b94534558b" returned: 0 in 0.922s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] <== create_volume: return (2469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:16:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.474s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.716s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2030934401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf677b3-6c16-4bb4-b57a-2e74c1a83af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='014d418a12f949c28580939ead48407b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:16:31Z,use_quota=True,user_id='9854acea47f74aba85cd5c1d824785f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:16:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Creating volume 3cf677b3-6c16-4bb4-b57a-2e74c1a83af7 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:16:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:16:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:16:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:16:34 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:16:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3cf677b3-6c16-4bb4-b57a-2e74c1a83af7 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298706fa-5e76-4fdb-91eb-ee8f4125b35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-805a8541-29eb-4d41-8392-d7b94534558b', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a98a1b-5081-442a-9db5-1aa66985a397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:35 devstack sudo[101782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3cf677b3-6c16-4bb4-b57a-2e74c1a83af7 1073741824
Jul 03 13:16:35 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:35 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Volume volume-805a8541-29eb-4d41-8392-d7b94534558b (805a8541-29eb-4d41-8392-d7b94534558b): created successfully
Jul 03 13:16:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a98a1b-5081-442a-9db5-1aa66985a397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Flow 'volume_create_manager' (1c2bd294-aa9c-4dbe-a797-03ea79a61cf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:16:35 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-c132bc37-4ac2-4ed1-bdbf-01902d54bac8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Created volume successfully.
Jul 03 13:16:35 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3cf677b3-6c16-4bb4-b57a-2e74c1a83af7 1073741824" returned: 0 in 1.023s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3cf677b3-6c16-4bb4-b57a-2e74c1a83af7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:36 devstack sudo[101791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3cf677b3-6c16-4bb4-b57a-2e74c1a83af7
Jul 03 13:16:36 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:36 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3cf677b3-6c16-4bb4-b57a-2e74c1a83af7" returned: 0 in 0.733s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:16:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.543s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:16:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1240305742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d758a32d-67e7-47be-b214-5640df9c84be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e4b106e6c549118fac5c2141ea953c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:16:34Z,use_quota=True,user_id='858e52cfe2314148a6725aa6e3d91eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:16:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Creating volume d758a32d-67e7-47be-b214-5640df9c84be {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:16:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:16:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:16:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:16:36 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:16:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:36 devstack sudo[101794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be 1073741824
Jul 03 13:16:36 devstack sudo[101794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e7b825-7b6f-45f5-b1bc-0965c702c505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cf677b3-6c16-4bb4-b57a-2e74c1a83af7', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83102c68-ff62-4be4-aaeb-a8037ccecfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:36 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Volume volume-3cf677b3-6c16-4bb4-b57a-2e74c1a83af7 (3cf677b3-6c16-4bb4-b57a-2e74c1a83af7): created successfully
Jul 03 13:16:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83102c68-ff62-4be4-aaeb-a8037ccecfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Flow 'volume_create_manager' (f137b333-f42e-4660-ab9f-d54f0be40040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:16:36 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-1b89ca5c-9926-472c-9943-5cb838667c3e tempest-TestServerVolumeAttachmentScenario-2110006989 None] Created volume successfully.
Jul 03 13:16:37 devstack sudo[101794]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be 1073741824" returned: 0 in 0.908s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:37 devstack sudo[101803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be
Jul 03 13:16:37 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:38 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be" returned: 0 in 0.674s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:38 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:16:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79708a68-96d8-4102-81eb-2c43731c7806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d758a32d-67e7-47be-b214-5640df9c84be', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c6f141-955b-4228-91fa-cee2938cbce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:16:38 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Volume volume-d758a32d-67e7-47be-b214-5640df9c84be (d758a32d-67e7-47be-b214-5640df9c84be): created successfully
Jul 03 13:16:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c6f141-955b-4228-91fa-cee2938cbce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:16:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Flow 'volume_create_manager' (35feeea6-23ed-430c-950d-9d8d42f23943) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:16:38 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-8d361cca-b2d1-4d11-9c13-0fab51b96d50 tempest-CinderUnicodeTest-410905251 None] Created volume successfully.
Jul 03 13:16:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-59a24f62-e07c-40a8-98f8-d210ad34848c tempest-CinderUnicodeTest-410905251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-59a24f62-e07c-40a8-98f8-d210ad34848c tempest-CinderUnicodeTest-410905251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-59a24f62-e07c-40a8-98f8-d210ad34848c tempest-CinderUnicodeTest-410905251 None] Creating offline snapshot 4106b8fb-0791-4712-987e-2df109d95381 of volume d758a32d-67e7-47be-b214-5640df9c84be {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:16:39 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cbef49-5aba-4302-9502-b9866e9fbe5c]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59a24f62-e07c-40a8-98f8-d210ad34848c tempest-CinderUnicodeTest-410905251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:40 devstack sudo[101865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be
Jul 03 13:16:40 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:41 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59a24f62-e07c-40a8-98f8-d210ad34848c tempest-CinderUnicodeTest-410905251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be" returned: 0 in 1.056s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59a24f62-e07c-40a8-98f8-d210ad34848c tempest-CinderUnicodeTest-410905251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be.4106b8fb-0791-4712-987e-2df109d95381 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:41 devstack sudo[101877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be.4106b8fb-0791-4712-987e-2df109d95381 1G
Jul 03 13:16:41 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59a24f62-e07c-40a8-98f8-d210ad34848c tempest-CinderUnicodeTest-410905251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be.4106b8fb-0791-4712-987e-2df109d95381 1G" returned: 0 in 1.595s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:42 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59a24f62-e07c-40a8-98f8-d210ad34848c tempest-CinderUnicodeTest-410905251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d758a32d-67e7-47be-b214-5640df9c84be -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be.4106b8fb-0791-4712-987e-2df109d95381 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:42 devstack sudo[101892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d758a32d-67e7-47be-b214-5640df9c84be -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be.4106b8fb-0791-4712-987e-2df109d95381
Jul 03 13:16:42 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:43 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59a24f62-e07c-40a8-98f8-d210ad34848c tempest-CinderUnicodeTest-410905251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d758a32d-67e7-47be-b214-5640df9c84be -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be.4106b8fb-0791-4712-987e-2df109d95381" returned: 0 in 1.190s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:43 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-59a24f62-e07c-40a8-98f8-d210ad34848c tempest-CinderUnicodeTest-410905251 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be.4106b8fb-0791-4712-987e-2df109d95381 is being set with open permissions: ugo+rw
Jul 03 13:16:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59a24f62-e07c-40a8-98f8-d210ad34848c tempest-CinderUnicodeTest-410905251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be.4106b8fb-0791-4712-987e-2df109d95381 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:43 devstack sudo[101906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be.4106b8fb-0791-4712-987e-2df109d95381
Jul 03 13:16:43 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:44 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59a24f62-e07c-40a8-98f8-d210ad34848c tempest-CinderUnicodeTest-410905251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be.4106b8fb-0791-4712-987e-2df109d95381" returned: 0 in 0.908s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59a24f62-e07c-40a8-98f8-d210ad34848c tempest-CinderUnicodeTest-410905251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:44 devstack sudo[101947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be.info
Jul 03 13:16:44 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:45 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59a24f62-e07c-40a8-98f8-d210ad34848c tempest-CinderUnicodeTest-410905251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be.info" returned: 0 in 0.685s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:45 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-59a24f62-e07c-40a8-98f8-d210ad34848c tempest-CinderUnicodeTest-410905251 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be.info is being set with open permissions: ugo+rw
Jul 03 13:16:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59a24f62-e07c-40a8-98f8-d210ad34848c tempest-CinderUnicodeTest-410905251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:45 devstack sudo[101951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be.info
Jul 03 13:16:45 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:46 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-59a24f62-e07c-40a8-98f8-d210ad34848c tempest-CinderUnicodeTest-410905251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be.info" returned: 0 in 0.931s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-59a24f62-e07c-40a8-98f8-d210ad34848c tempest-CinderUnicodeTest-410905251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.544s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:46 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-59a24f62-e07c-40a8-98f8-d210ad34848c tempest-CinderUnicodeTest-410905251 None] Create snapshot completed successfully
Jul 03 13:16:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5b660da3-eaea-4bdc-847a-5634d5c019ff tempest-CinderUnicodeTest-410905251 None] Acquiring lock "cinder-4106b8fb-0791-4712-987e-2df109d95381-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5b660da3-eaea-4bdc-847a-5634d5c019ff tempest-CinderUnicodeTest-410905251 None] Lock "cinder-4106b8fb-0791-4712-987e-2df109d95381-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5b660da3-eaea-4bdc-847a-5634d5c019ff tempest-CinderUnicodeTest-410905251 None] Acquiring lock "cinder-quobyte-d758a32d-67e7-47be-b214-5640df9c84be" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5b660da3-eaea-4bdc-847a-5634d5c019ff tempest-CinderUnicodeTest-410905251 None] Lock "cinder-quobyte-d758a32d-67e7-47be-b214-5640df9c84be" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5b660da3-eaea-4bdc-847a-5634d5c019ff tempest-CinderUnicodeTest-410905251 None] Acquiring lock "cinder-quobyte-4106b8fb-0791-4712-987e-2df109d95381" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5b660da3-eaea-4bdc-847a-5634d5c019ff tempest-CinderUnicodeTest-410905251 None] Lock "cinder-quobyte-4106b8fb-0791-4712-987e-2df109d95381" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:47 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-5b660da3-eaea-4bdc-847a-5634d5c019ff tempest-CinderUnicodeTest-410905251 None] Deleting offline snapshot 4106b8fb-0791-4712-987e-2df109d95381 of volume d758a32d-67e7-47be-b214-5640df9c84be {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:16:47 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-5b660da3-eaea-4bdc-847a-5634d5c019ff tempest-CinderUnicodeTest-410905251 None] snapshot_file for this snap is: volume-d758a32d-67e7-47be-b214-5640df9c84be.4106b8fb-0791-4712-987e-2df109d95381 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:16:47 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[239bec69-a144-43b8-b48d-ae26b606a4d1]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5b660da3-eaea-4bdc-847a-5634d5c019ff tempest-CinderUnicodeTest-410905251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be.4106b8fb-0791-4712-987e-2df109d95381 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:47 devstack sudo[101958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be.4106b8fb-0791-4712-987e-2df109d95381
Jul 03 13:16:47 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:48 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5b660da3-eaea-4bdc-847a-5634d5c019ff tempest-CinderUnicodeTest-410905251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be.4106b8fb-0791-4712-987e-2df109d95381" returned: 0 in 0.825s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:48 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-5b660da3-eaea-4bdc-847a-5634d5c019ff tempest-CinderUnicodeTest-410905251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d758a32d-67e7-47be-b214-5640df9c84be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:16:48 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf161d42-27c3-46bd-bde4-b3e7e8213313]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5b660da3-eaea-4bdc-847a-5634d5c019ff tempest-CinderUnicodeTest-410905251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:48 devstack sudo[101964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be
Jul 03 13:16:48 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:49 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5b660da3-eaea-4bdc-847a-5634d5c019ff tempest-CinderUnicodeTest-410905251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be" returned: 0 in 1.151s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5b660da3-eaea-4bdc-847a-5634d5c019ff tempest-CinderUnicodeTest-410905251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be.4106b8fb-0791-4712-987e-2df109d95381 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:49 devstack sudo[102016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be.4106b8fb-0791-4712-987e-2df109d95381
Jul 03 13:16:49 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:50 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5b660da3-eaea-4bdc-847a-5634d5c019ff tempest-CinderUnicodeTest-410905251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be.4106b8fb-0791-4712-987e-2df109d95381" returned: 0 in 1.307s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5b660da3-eaea-4bdc-847a-5634d5c019ff tempest-CinderUnicodeTest-410905251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be.4106b8fb-0791-4712-987e-2df109d95381 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:50 devstack sudo[102041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be.4106b8fb-0791-4712-987e-2df109d95381
Jul 03 13:16:50 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:51 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5b660da3-eaea-4bdc-847a-5634d5c019ff tempest-CinderUnicodeTest-410905251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be.4106b8fb-0791-4712-987e-2df109d95381" returned: 0 in 0.785s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:51 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:UPDATE=76,cinder:SELECT=51,cinder:INSERT=19,cinder:DELETE=9 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:16:51 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5b660da3-eaea-4bdc-847a-5634d5c019ff tempest-CinderUnicodeTest-410905251 None] Lock "cinder-quobyte-4106b8fb-0791-4712-987e-2df109d95381" released by "_delete_snapshot" :: held 4.276s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:51 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5b660da3-eaea-4bdc-847a-5634d5c019ff tempest-CinderUnicodeTest-410905251 None] Lock "cinder-quobyte-d758a32d-67e7-47be-b214-5640df9c84be" released by "delete_snapshot" :: held 4.314s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:51 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-5b660da3-eaea-4bdc-847a-5634d5c019ff tempest-CinderUnicodeTest-410905251 None] Created reservations ['59a40c11-e4cd-4836-bba0-1d6ef38e38cd', '56d88538-c717-4fc5-85c3-36855d8566a5', '59978576-c4a6-42e9-af54-5b94afa66c65', 'b42126d0-16af-4e61-86ef-fd021878c6d2'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:16:51 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-5b660da3-eaea-4bdc-847a-5634d5c019ff tempest-CinderUnicodeTest-410905251 None] Delete snapshot completed successfully.
Jul 03 13:16:51 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5b660da3-eaea-4bdc-847a-5634d5c019ff tempest-CinderUnicodeTest-410905251 None] Lock "cinder-4106b8fb-0791-4712-987e-2df109d95381-delete_snapshot" released by "delete_snapshot" :: held 4.512s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:52 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-98b07fe3-5481-4a88-bc8f-8c2fba09406a tempest-CinderUnicodeTest-410905251 None] Acquiring lock "cinder-d758a32d-67e7-47be-b214-5640df9c84be-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:52 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-98b07fe3-5481-4a88-bc8f-8c2fba09406a tempest-CinderUnicodeTest-410905251 None] Lock "cinder-d758a32d-67e7-47be-b214-5640df9c84be-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:52 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-98b07fe3-5481-4a88-bc8f-8c2fba09406a tempest-CinderUnicodeTest-410905251 None] Acquiring lock "cinder-quobyte-d758a32d-67e7-47be-b214-5640df9c84be" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:52 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-98b07fe3-5481-4a88-bc8f-8c2fba09406a tempest-CinderUnicodeTest-410905251 None] Lock "cinder-quobyte-d758a32d-67e7-47be-b214-5640df9c84be" acquired by "delete_volume" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:52 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a17fa73-c9cd-4cb0-8572-ad2baa1e40d4]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-98b07fe3-5481-4a88-bc8f-8c2fba09406a tempest-CinderUnicodeTest-410905251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:53 devstack sudo[102045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be
Jul 03 13:16:53 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:54 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-98b07fe3-5481-4a88-bc8f-8c2fba09406a tempest-CinderUnicodeTest-410905251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be" returned: 0 in 1.092s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-98b07fe3-5481-4a88-bc8f-8c2fba09406a tempest-CinderUnicodeTest-410905251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:54 devstack sudo[102052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be
Jul 03 13:16:54 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:54 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-98b07fe3-5481-4a88-bc8f-8c2fba09406a tempest-CinderUnicodeTest-410905251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d758a32d-67e7-47be-b214-5640df9c84be" returned: 0 in 0.836s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:54 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-98b07fe3-5481-4a88-bc8f-8c2fba09406a tempest-CinderUnicodeTest-410905251 None] Lock "cinder-quobyte-d758a32d-67e7-47be-b214-5640df9c84be" released by "delete_volume" :: held 2.018s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:54 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-98b07fe3-5481-4a88-bc8f-8c2fba09406a tempest-CinderUnicodeTest-410905251 None] Created reservations ['373e2b56-d550-478c-903a-45397241141f', '3186f479-693f-4c74-91be-e7adceadbda0', '19ef7f3f-3082-4e1e-9373-e8e908275460', 'b79fa190-884f-4e26-85b9-fff6d7226be3'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:16:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-98b07fe3-5481-4a88-bc8f-8c2fba09406a tempest-CinderUnicodeTest-410905251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-98b07fe3-5481-4a88-bc8f-8c2fba09406a tempest-CinderUnicodeTest-410905251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:55 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-98b07fe3-5481-4a88-bc8f-8c2fba09406a tempest-CinderUnicodeTest-410905251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:16:55 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-98b07fe3-5481-4a88-bc8f-8c2fba09406a tempest-CinderUnicodeTest-410905251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:16:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-98b07fe3-5481-4a88-bc8f-8c2fba09406a tempest-CinderUnicodeTest-410905251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-98b07fe3-5481-4a88-bc8f-8c2fba09406a tempest-CinderUnicodeTest-410905251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:55 devstack sudo[102057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:16:55 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9380b9e2-892c-4194-9136-d8a16c27e0fb tempest-CinderUnicodeTest-410905251 None] Acquiring lock "cinder-7b938d8d-1568-48d3-b057-be1970d7db85-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9380b9e2-892c-4194-9136-d8a16c27e0fb tempest-CinderUnicodeTest-410905251 None] Lock "cinder-7b938d8d-1568-48d3-b057-be1970d7db85-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9380b9e2-892c-4194-9136-d8a16c27e0fb tempest-CinderUnicodeTest-410905251 None] Acquiring lock "cinder-quobyte-7b938d8d-1568-48d3-b057-be1970d7db85" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9380b9e2-892c-4194-9136-d8a16c27e0fb tempest-CinderUnicodeTest-410905251 None] Lock "cinder-quobyte-7b938d8d-1568-48d3-b057-be1970d7db85" acquired by "delete_volume" :: waited 0.037s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:55 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5efe3e-6a05-4e6c-8ccc-a467040baa6d]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9380b9e2-892c-4194-9136-d8a16c27e0fb tempest-CinderUnicodeTest-410905251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7b938d8d-1568-48d3-b057-be1970d7db85 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:55 devstack sudo[102059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7b938d8d-1568-48d3-b057-be1970d7db85
Jul 03 13:16:55 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:56 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-98b07fe3-5481-4a88-bc8f-8c2fba09406a tempest-CinderUnicodeTest-410905251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.079s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:56 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-98b07fe3-5481-4a88-bc8f-8c2fba09406a tempest-CinderUnicodeTest-410905251 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:16:56 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-98b07fe3-5481-4a88-bc8f-8c2fba09406a tempest-CinderUnicodeTest-410905251 None] Deleted volume successfully.
Jul 03 13:16:56 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-98b07fe3-5481-4a88-bc8f-8c2fba09406a tempest-CinderUnicodeTest-410905251 None] Lock "cinder-d758a32d-67e7-47be-b214-5640df9c84be-delete_volume" released by "delete_volume" :: held 3.357s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:56 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9380b9e2-892c-4194-9136-d8a16c27e0fb tempest-CinderUnicodeTest-410905251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7b938d8d-1568-48d3-b057-be1970d7db85" returned: 0 in 1.118s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9380b9e2-892c-4194-9136-d8a16c27e0fb tempest-CinderUnicodeTest-410905251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7b938d8d-1568-48d3-b057-be1970d7db85 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:56 devstack sudo[102065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7b938d8d-1568-48d3-b057-be1970d7db85
Jul 03 13:16:56 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:57 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9380b9e2-892c-4194-9136-d8a16c27e0fb tempest-CinderUnicodeTest-410905251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7b938d8d-1568-48d3-b057-be1970d7db85" returned: 0 in 0.788s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9380b9e2-892c-4194-9136-d8a16c27e0fb tempest-CinderUnicodeTest-410905251 None] Lock "cinder-quobyte-7b938d8d-1568-48d3-b057-be1970d7db85" released by "delete_volume" :: held 1.986s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:57 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-9380b9e2-892c-4194-9136-d8a16c27e0fb tempest-CinderUnicodeTest-410905251 None] Created reservations ['5e56317c-0cb6-418a-b8b2-aef929e5a87e', 'e3ba221d-9533-4b66-b5a5-eb1141051117', '8dc72291-dfc4-433d-a5ea-db7090f095d6', '30864997-609d-4e7c-8ddc-d32d4bc762cb'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:16:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9380b9e2-892c-4194-9136-d8a16c27e0fb tempest-CinderUnicodeTest-410905251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:16:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9380b9e2-892c-4194-9136-d8a16c27e0fb tempest-CinderUnicodeTest-410905251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:16:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9380b9e2-892c-4194-9136-d8a16c27e0fb tempest-CinderUnicodeTest-410905251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:16:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9380b9e2-892c-4194-9136-d8a16c27e0fb tempest-CinderUnicodeTest-410905251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:16:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9380b9e2-892c-4194-9136-d8a16c27e0fb tempest-CinderUnicodeTest-410905251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:16:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9380b9e2-892c-4194-9136-d8a16c27e0fb tempest-CinderUnicodeTest-410905251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:57 devstack sudo[102069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:16:57 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:58 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9380b9e2-892c-4194-9136-d8a16c27e0fb tempest-CinderUnicodeTest-410905251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.771s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:58 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-9380b9e2-892c-4194-9136-d8a16c27e0fb tempest-CinderUnicodeTest-410905251 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:16:58 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-9380b9e2-892c-4194-9136-d8a16c27e0fb tempest-CinderUnicodeTest-410905251 None] Deleted volume successfully.
Jul 03 13:16:58 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9380b9e2-892c-4194-9136-d8a16c27e0fb tempest-CinderUnicodeTest-410905251 None] Lock "cinder-7b938d8d-1568-48d3-b057-be1970d7db85-delete_volume" released by "delete_volume" :: held 3.136s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:16:58 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a46af5d6-ba04-42aa-b619-90540fec7d11 tempest-VolumesNegativeTest-878032950 None] Acquiring lock "cinder-99c48e8b-7e69-4134-ae47-e1b040b4dd71-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:58 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a46af5d6-ba04-42aa-b619-90540fec7d11 tempest-VolumesNegativeTest-878032950 None] Lock "cinder-99c48e8b-7e69-4134-ae47-e1b040b4dd71-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:58 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a46af5d6-ba04-42aa-b619-90540fec7d11 tempest-VolumesNegativeTest-878032950 None] Acquiring lock "cinder-quobyte-99c48e8b-7e69-4134-ae47-e1b040b4dd71" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:16:58 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a46af5d6-ba04-42aa-b619-90540fec7d11 tempest-VolumesNegativeTest-878032950 None] Lock "cinder-quobyte-99c48e8b-7e69-4134-ae47-e1b040b4dd71" acquired by "delete_volume" :: waited 0.027s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:16:58 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[b722e647-cd81-4ae1-995e-94e8915b547f]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:16:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a46af5d6-ba04-42aa-b619-90540fec7d11 tempest-VolumesNegativeTest-878032950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-99c48e8b-7e69-4134-ae47-e1b040b4dd71 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:58 devstack sudo[102081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-99c48e8b-7e69-4134-ae47-e1b040b4dd71
Jul 03 13:16:58 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:16:59 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root
Jul 03 13:16:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a46af5d6-ba04-42aa-b619-90540fec7d11 tempest-VolumesNegativeTest-878032950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-99c48e8b-7e69-4134-ae47-e1b040b4dd71" returned: 0 in 0.854s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:16:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a46af5d6-ba04-42aa-b619-90540fec7d11 tempest-VolumesNegativeTest-878032950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-99c48e8b-7e69-4134-ae47-e1b040b4dd71 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:16:59 devstack sudo[102086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-99c48e8b-7e69-4134-ae47-e1b040b4dd71
Jul 03 13:16:59 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:00 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a46af5d6-ba04-42aa-b619-90540fec7d11 tempest-VolumesNegativeTest-878032950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-99c48e8b-7e69-4134-ae47-e1b040b4dd71" returned: 0 in 0.984s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:00 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a46af5d6-ba04-42aa-b619-90540fec7d11 tempest-VolumesNegativeTest-878032950 None] Lock "cinder-quobyte-99c48e8b-7e69-4134-ae47-e1b040b4dd71" released by "delete_volume" :: held 1.896s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:17:00 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-a46af5d6-ba04-42aa-b619-90540fec7d11 tempest-VolumesNegativeTest-878032950 None] Created reservations ['e4a15070-9bca-4b74-9893-850af87faa23', '43562b1d-c633-42e7-b15f-984bbc153a67', '4115b1e7-5418-496b-9902-152748ce72a9', '93f8f48a-fbe2-48fa-9a48-5cb075a6732d'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:17:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a46af5d6-ba04-42aa-b619-90540fec7d11 tempest-VolumesNegativeTest-878032950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:17:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a46af5d6-ba04-42aa-b619-90540fec7d11 tempest-VolumesNegativeTest-878032950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:17:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a46af5d6-ba04-42aa-b619-90540fec7d11 tempest-VolumesNegativeTest-878032950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:17:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a46af5d6-ba04-42aa-b619-90540fec7d11 tempest-VolumesNegativeTest-878032950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:17:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a46af5d6-ba04-42aa-b619-90540fec7d11 tempest-VolumesNegativeTest-878032950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:17:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a46af5d6-ba04-42aa-b619-90540fec7d11 tempest-VolumesNegativeTest-878032950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:00 devstack sudo[102091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:17:00 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:01 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a46af5d6-ba04-42aa-b619-90540fec7d11 tempest-VolumesNegativeTest-878032950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.073s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:01 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-a46af5d6-ba04-42aa-b619-90540fec7d11 tempest-VolumesNegativeTest-878032950 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:17:01 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-a46af5d6-ba04-42aa-b619-90540fec7d11 tempest-VolumesNegativeTest-878032950 None] Deleted volume successfully.
Jul 03 13:17:01 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a46af5d6-ba04-42aa-b619-90540fec7d11 tempest-VolumesNegativeTest-878032950 None] Lock "cinder-99c48e8b-7e69-4134-ae47-e1b040b4dd71-delete_volume" released by "delete_volume" :: held 3.298s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:17:04 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:17:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Flow 'volume_create_manager' (2589d929-0aed-4d81-989f-cc31779eea17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:17:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3812f5-ab68-4777-9783-929e1e3eb5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3812f5-ab68-4777-9783-929e1e3eb5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-861204836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae4cd96a-38f7-4791-84e9-0941a0ae4169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de1f9ed4f813449681f94b6fc4256ac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:17:04Z,use_quota=True,user_id='21a8d514cc53416484031152488505cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f3399c-1df6-4bb8-a9eb-f80b0a2d31f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f3399c-1df6-4bb8-a9eb-f80b0a2d31f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b1c3f3-cb58-46f4-9b9f-e38237026087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b1c3f3-cb58-46f4-9b9f-e38237026087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae4cd96a-38f7-4791-84e9-0941a0ae4169', 'volume_name': 'volume-ae4cd96a-38f7-4791-84e9-0941a0ae4169', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912016ae-c19d-41f5-be77-19a5f80ef207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912016ae-c19d-41f5-be77-19a5f80ef207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad0a602c-b281-4c23-a786-f6597c676961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:04 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Volume ae4cd96a-38f7-4791-84e9-0941a0ae4169: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae4cd96a-38f7-4791-84e9-0941a0ae4169', 'volume_size': 1}
Jul 03 13:17:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:17:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:17:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-861204836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae4cd96a-38f7-4791-84e9-0941a0ae4169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de1f9ed4f813449681f94b6fc4256ac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:17:04Z,use_quota=True,user_id='21a8d514cc53416484031152488505cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:17:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Creating volume ae4cd96a-38f7-4791-84e9-0941a0ae4169 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:17:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:17:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:17:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:17:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:17:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:17:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:17:04 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:17:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ae4cd96a-38f7-4791-84e9-0941a0ae4169 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:04 devstack sudo[102119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ae4cd96a-38f7-4791-84e9-0941a0ae4169 1073741824
Jul 03 13:17:04 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:05 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ae4cd96a-38f7-4791-84e9-0941a0ae4169 1073741824" returned: 0 in 0.969s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ae4cd96a-38f7-4791-84e9-0941a0ae4169 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:05 devstack sudo[102125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ae4cd96a-38f7-4791-84e9-0941a0ae4169
Jul 03 13:17:05 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:06 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ae4cd96a-38f7-4791-84e9-0941a0ae4169" returned: 0 in 0.721s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:17:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:17:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad0a602c-b281-4c23-a786-f6597c676961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae4cd96a-38f7-4791-84e9-0941a0ae4169', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d08db7-6a5f-4770-9621-d5e4bc466264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:06 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Volume volume-ae4cd96a-38f7-4791-84e9-0941a0ae4169 (ae4cd96a-38f7-4791-84e9-0941a0ae4169): created successfully
Jul 03 13:17:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d08db7-6a5f-4770-9621-d5e4bc466264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Flow 'volume_create_manager' (2589d929-0aed-4d81-989f-cc31779eea17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:17:06 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-1878de8a-410f-4985-bef2-f48c3589bf5c tempest-ProjectReaderTests-1655873210 None] Created volume successfully.
Jul 03 13:17:06 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b6825c8f-2a89-447f-961c-be30eb1efb72 tempest-ProjectReaderTests-1655873210 None] Acquiring lock "cinder-ae4cd96a-38f7-4791-84e9-0941a0ae4169-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:17:06 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b6825c8f-2a89-447f-961c-be30eb1efb72 tempest-ProjectReaderTests-1655873210 None] Lock "cinder-ae4cd96a-38f7-4791-84e9-0941a0ae4169-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:17:06 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b6825c8f-2a89-447f-961c-be30eb1efb72 tempest-ProjectReaderTests-1655873210 None] Acquiring lock "cinder-quobyte-ae4cd96a-38f7-4791-84e9-0941a0ae4169" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:17:06 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b6825c8f-2a89-447f-961c-be30eb1efb72 tempest-ProjectReaderTests-1655873210 None] Lock "cinder-quobyte-ae4cd96a-38f7-4791-84e9-0941a0ae4169" acquired by "delete_volume" :: waited 0.018s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:17:06 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd45953-359f-4a2f-9379-88696b976ceb]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:17:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b6825c8f-2a89-447f-961c-be30eb1efb72 tempest-ProjectReaderTests-1655873210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ae4cd96a-38f7-4791-84e9-0941a0ae4169 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:06 devstack sudo[102128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ae4cd96a-38f7-4791-84e9-0941a0ae4169
Jul 03 13:17:06 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:07 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b6825c8f-2a89-447f-961c-be30eb1efb72 tempest-ProjectReaderTests-1655873210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ae4cd96a-38f7-4791-84e9-0941a0ae4169" returned: 0 in 0.855s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b6825c8f-2a89-447f-961c-be30eb1efb72 tempest-ProjectReaderTests-1655873210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ae4cd96a-38f7-4791-84e9-0941a0ae4169 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:07 devstack sudo[102133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ae4cd96a-38f7-4791-84e9-0941a0ae4169
Jul 03 13:17:07 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:08 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b6825c8f-2a89-447f-961c-be30eb1efb72 tempest-ProjectReaderTests-1655873210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ae4cd96a-38f7-4791-84e9-0941a0ae4169" returned: 0 in 0.649s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b6825c8f-2a89-447f-961c-be30eb1efb72 tempest-ProjectReaderTests-1655873210 None] Lock "cinder-quobyte-ae4cd96a-38f7-4791-84e9-0941a0ae4169" released by "delete_volume" :: held 1.548s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:17:08 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-b6825c8f-2a89-447f-961c-be30eb1efb72 tempest-ProjectReaderTests-1655873210 None] Created reservations ['6a9ecc61-3796-4ef7-a72e-a691f87c1aa8', 'db325383-0220-4946-b687-3e49aed0a1ca', '65f3b744-2e2b-4a53-9719-2869fb34cf62', '19dd4eb0-0881-461f-834a-20d5061c123b'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:17:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b6825c8f-2a89-447f-961c-be30eb1efb72 tempest-ProjectReaderTests-1655873210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:17:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b6825c8f-2a89-447f-961c-be30eb1efb72 tempest-ProjectReaderTests-1655873210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:17:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b6825c8f-2a89-447f-961c-be30eb1efb72 tempest-ProjectReaderTests-1655873210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:17:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b6825c8f-2a89-447f-961c-be30eb1efb72 tempest-ProjectReaderTests-1655873210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:17:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b6825c8f-2a89-447f-961c-be30eb1efb72 tempest-ProjectReaderTests-1655873210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:17:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b6825c8f-2a89-447f-961c-be30eb1efb72 tempest-ProjectReaderTests-1655873210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:08 devstack sudo[102136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:17:08 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:09 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b6825c8f-2a89-447f-961c-be30eb1efb72 tempest-ProjectReaderTests-1655873210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.817s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:09 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-b6825c8f-2a89-447f-961c-be30eb1efb72 tempest-ProjectReaderTests-1655873210 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:17:09 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-b6825c8f-2a89-447f-961c-be30eb1efb72 tempest-ProjectReaderTests-1655873210 None] Deleted volume successfully.
Jul 03 13:17:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b6825c8f-2a89-447f-961c-be30eb1efb72 tempest-ProjectReaderTests-1655873210 None] Lock "cinder-ae4cd96a-38f7-4791-84e9-0941a0ae4169-delete_volume" released by "delete_volume" :: held 2.670s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:17:09 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:17:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Flow 'volume_create_manager' (27dc1de0-98f5-4e9d-9378-acb6a3964052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:17:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e13ae8d7-f587-4ff5-9adc-eb2569da381b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e13ae8d7-f587-4ff5-9adc-eb2569da381b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1651944499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc01447-9e95-44b2-9bb2-f8b6995a4ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de1f9ed4f813449681f94b6fc4256ac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:17:09Z,use_quota=True,user_id='21a8d514cc53416484031152488505cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c65ed0-e875-4bb2-8305-b1a0a0ce0e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c65ed0-e875-4bb2-8305-b1a0a0ce0e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed96429-d8af-47a8-8ef1-83db02cd3a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed96429-d8af-47a8-8ef1-83db02cd3a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cc01447-9e95-44b2-9bb2-f8b6995a4ea6', 'volume_name': 'volume-8cc01447-9e95-44b2-9bb2-f8b6995a4ea6', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19827b8d-56e7-4b6e-a3b7-3715a099b079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19827b8d-56e7-4b6e-a3b7-3715a099b079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e760e78b-7928-41a9-884b-aea7229dc7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:09 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Volume 8cc01447-9e95-44b2-9bb2-f8b6995a4ea6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cc01447-9e95-44b2-9bb2-f8b6995a4ea6', 'volume_size': 1}
Jul 03 13:17:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:17:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:17:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1651944499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc01447-9e95-44b2-9bb2-f8b6995a4ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de1f9ed4f813449681f94b6fc4256ac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:17:09Z,use_quota=True,user_id='21a8d514cc53416484031152488505cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:17:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Creating volume 8cc01447-9e95-44b2-9bb2-f8b6995a4ea6 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:17:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:17:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:17:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:17:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:17:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:17:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:17:09 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:17:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8cc01447-9e95-44b2-9bb2-f8b6995a4ea6 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:09 devstack sudo[102139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8cc01447-9e95-44b2-9bb2-f8b6995a4ea6 1073741824
Jul 03 13:17:09 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:10 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8cc01447-9e95-44b2-9bb2-f8b6995a4ea6 1073741824" returned: 0 in 1.054s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8cc01447-9e95-44b2-9bb2-f8b6995a4ea6 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:10 devstack sudo[102145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8cc01447-9e95-44b2-9bb2-f8b6995a4ea6
Jul 03 13:17:10 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:11 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8cc01447-9e95-44b2-9bb2-f8b6995a4ea6" returned: 0 in 0.814s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:17:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.938s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:17:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e760e78b-7928-41a9-884b-aea7229dc7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cc01447-9e95-44b2-9bb2-f8b6995a4ea6', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0bce883-da63-4d53-af8b-eaee6d78f458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:11 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Volume volume-8cc01447-9e95-44b2-9bb2-f8b6995a4ea6 (8cc01447-9e95-44b2-9bb2-f8b6995a4ea6): created successfully
Jul 03 13:17:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0bce883-da63-4d53-af8b-eaee6d78f458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Flow 'volume_create_manager' (27dc1de0-98f5-4e9d-9378-acb6a3964052) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:17:11 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-93461d30-d486-4961-b5b9-40a50ad9ebc1 tempest-ProjectReaderTests-1655873210 None] Created volume successfully.
Jul 03 13:17:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ab0beab6-489f-4892-b374-b235d7c17689 tempest-ProjectReaderTests-1655873210 None] Acquiring lock "cinder-8cc01447-9e95-44b2-9bb2-f8b6995a4ea6-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:17:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ab0beab6-489f-4892-b374-b235d7c17689 tempest-ProjectReaderTests-1655873210 None] Lock "cinder-8cc01447-9e95-44b2-9bb2-f8b6995a4ea6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:17:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ab0beab6-489f-4892-b374-b235d7c17689 tempest-ProjectReaderTests-1655873210 None] Acquiring lock "cinder-quobyte-8cc01447-9e95-44b2-9bb2-f8b6995a4ea6" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:17:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ab0beab6-489f-4892-b374-b235d7c17689 tempest-ProjectReaderTests-1655873210 None] Lock "cinder-quobyte-8cc01447-9e95-44b2-9bb2-f8b6995a4ea6" acquired by "delete_volume" :: waited 0.016s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:17:12 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[491ab24c-a8b3-4300-b897-b39abe95d515]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:17:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ab0beab6-489f-4892-b374-b235d7c17689 tempest-ProjectReaderTests-1655873210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8cc01447-9e95-44b2-9bb2-f8b6995a4ea6 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:12 devstack sudo[102148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8cc01447-9e95-44b2-9bb2-f8b6995a4ea6
Jul 03 13:17:12 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:13 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ab0beab6-489f-4892-b374-b235d7c17689 tempest-ProjectReaderTests-1655873210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8cc01447-9e95-44b2-9bb2-f8b6995a4ea6" returned: 0 in 0.871s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ab0beab6-489f-4892-b374-b235d7c17689 tempest-ProjectReaderTests-1655873210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8cc01447-9e95-44b2-9bb2-f8b6995a4ea6 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:13 devstack sudo[102156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8cc01447-9e95-44b2-9bb2-f8b6995a4ea6
Jul 03 13:17:13 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:14 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ab0beab6-489f-4892-b374-b235d7c17689 tempest-ProjectReaderTests-1655873210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8cc01447-9e95-44b2-9bb2-f8b6995a4ea6" returned: 0 in 0.756s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ab0beab6-489f-4892-b374-b235d7c17689 tempest-ProjectReaderTests-1655873210 None] Lock "cinder-quobyte-8cc01447-9e95-44b2-9bb2-f8b6995a4ea6" released by "delete_volume" :: held 1.683s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:17:14 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-ab0beab6-489f-4892-b374-b235d7c17689 tempest-ProjectReaderTests-1655873210 None] Created reservations ['d8a07494-3de2-4b06-b1ed-2d13dc1798b0', 'bfe8b97f-4e77-4674-87c6-6a0bbe8a9489', '8f812b65-c388-4ef8-b41b-b0b3638d8632', '7e4a214e-ed13-44ee-914a-1587564abb80'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:17:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ab0beab6-489f-4892-b374-b235d7c17689 tempest-ProjectReaderTests-1655873210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:17:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ab0beab6-489f-4892-b374-b235d7c17689 tempest-ProjectReaderTests-1655873210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:17:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ab0beab6-489f-4892-b374-b235d7c17689 tempest-ProjectReaderTests-1655873210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:17:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ab0beab6-489f-4892-b374-b235d7c17689 tempest-ProjectReaderTests-1655873210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:17:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ab0beab6-489f-4892-b374-b235d7c17689 tempest-ProjectReaderTests-1655873210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:17:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ab0beab6-489f-4892-b374-b235d7c17689 tempest-ProjectReaderTests-1655873210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:14 devstack sudo[102161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:17:14 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:17:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:17:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:17:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:17:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:17:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:17:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:15 devstack sudo[102163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:17:15 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:15 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ab0beab6-489f-4892-b374-b235d7c17689 tempest-ProjectReaderTests-1655873210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.929s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:15 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-ab0beab6-489f-4892-b374-b235d7c17689 tempest-ProjectReaderTests-1655873210 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:17:15 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-ab0beab6-489f-4892-b374-b235d7c17689 tempest-ProjectReaderTests-1655873210 None] Deleted volume successfully.
Jul 03 13:17:15 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ab0beab6-489f-4892-b374-b235d7c17689 tempest-ProjectReaderTests-1655873210 None] Lock "cinder-8cc01447-9e95-44b2-9bb2-f8b6995a4ea6-delete_volume" released by "delete_volume" :: held 2.915s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:17:15 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:17:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Flow 'volume_create_manager' (aa4cdc7d-d1b4-4ab5-9b1b-300bca0149d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:17:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c80e8a-5a98-466e-8318-d89c5779255f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c80e8a-5a98-466e-8318-d89c5779255f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-808565960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10f69d74-e568-45dc-ae6b-1052cb4f7c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de1f9ed4f813449681f94b6fc4256ac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:17:16Z,use_quota=True,user_id='21a8d514cc53416484031152488505cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea1496b-e995-404a-ac5c-d07b819b4dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea1496b-e995-404a-ac5c-d07b819b4dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c27be45f-e264-4f71-8413-1f8a66e6d344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c27be45f-e264-4f71-8413-1f8a66e6d344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10f69d74-e568-45dc-ae6b-1052cb4f7c55', 'volume_name': 'volume-10f69d74-e568-45dc-ae6b-1052cb4f7c55', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1099f9b-ba79-4e65-8a9b-96af7b6fdfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1099f9b-ba79-4e65-8a9b-96af7b6fdfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69959f05-701f-4a8d-96e7-caf64bf0f1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:15 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Volume 10f69d74-e568-45dc-ae6b-1052cb4f7c55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10f69d74-e568-45dc-ae6b-1052cb4f7c55', 'volume_size': 1}
Jul 03 13:17:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:17:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:17:15 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-808565960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10f69d74-e568-45dc-ae6b-1052cb4f7c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de1f9ed4f813449681f94b6fc4256ac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:17:16Z,use_quota=True,user_id='21a8d514cc53416484031152488505cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:17:15 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Creating volume 10f69d74-e568-45dc-ae6b-1052cb4f7c55 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:17:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:17:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:17:15 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:17:15 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:17:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:17:15 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:17:15 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:17:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-10f69d74-e568-45dc-ae6b-1052cb4f7c55 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:15 devstack sudo[102170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-10f69d74-e568-45dc-ae6b-1052cb4f7c55 1073741824
Jul 03 13:17:15 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:16 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.091s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:16 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:17:16 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:17:16 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 28 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:17:16 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>, <Thread(tpool_thread_0, started daemon 134850092431040)>, <Thread(tpool_thread_1, started daemon 134850084021952)>, <Thread(tpool_thread_2, started daemon 134850075612864)>, <Thread(tpool_thread_3, started daemon 134850067203776)>, <Thread(tpool_thread_4, started daemon 134850058794688)>, <Thread(tpool_thread_5, started daemon 134850050385600)>, <Thread(tpool_thread_6, started daemon 134850041976512)>, <Thread(tpool_thread_7, started daemon 134850033567424)>, <Thread(tpool_thread_8, started daemon 134850025158336)>, <Thread(tpool_thread_9, started daemon 134850016749248)>, <Thread(tpool_thread_10, started daemon 134850008340160)>, <Thread(tpool_thread_11, started daemon 134849999931072)>, <Thread(tpool_thread_12, started daemon 134849991521984)>, <Thread(tpool_thread_13, started daemon 134849983112896)>, <Thread(tpool_thread_14, started daemon 134849974703808)>, <Thread(tpool_thread_15, started daemon 134849966294720)>, <Thread(tpool_thread_16, started daemon 134849957885632)>, <Thread(tpool_thread_17, started daemon 134849949476544)>, <Thread(tpool_thread_18, started daemon 134849941067456)>, <Thread(tpool_thread_19, started daemon 134849932658368)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:17:16 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-10f69d74-e568-45dc-ae6b-1052cb4f7c55 1073741824" returned: 0 in 1.108s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-10f69d74-e568-45dc-ae6b-1052cb4f7c55 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:17 devstack sudo[102176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-10f69d74-e568-45dc-ae6b-1052cb4f7c55
Jul 03 13:17:17 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:17 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-10f69d74-e568-45dc-ae6b-1052cb4f7c55" returned: 0 in 0.864s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:17 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] <== create_volume: return (2022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:17:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.029s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:17:17 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69959f05-701f-4a8d-96e7-caf64bf0f1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10f69d74-e568-45dc-ae6b-1052cb4f7c55', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:17 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77049d6e-b3ac-431e-9bf9-2ac32e27b4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:17 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Volume volume-10f69d74-e568-45dc-ae6b-1052cb4f7c55 (10f69d74-e568-45dc-ae6b-1052cb4f7c55): created successfully
Jul 03 13:17:17 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77049d6e-b3ac-431e-9bf9-2ac32e27b4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:17 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Flow 'volume_create_manager' (aa4cdc7d-d1b4-4ab5-9b1b-300bca0149d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:17:17 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-6f8b3b53-27fc-46fd-b4f2-47cc89d85136 tempest-ProjectReaderTests-1655873210 None] Created volume successfully.
Jul 03 13:17:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-1fda6204-e2c9-4185-a786-ccb61aa1d03f req-3bfb81e1-b5b9-4a5b-b3ff-519788cc7270 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:17:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-1fda6204-e2c9-4185-a786-ccb61aa1d03f req-3bfb81e1-b5b9-4a5b-b3ff-519788cc7270 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:17:18 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[401473b9-71e9-4eac-9984-ee4fa7968d1d]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:17:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-1fda6204-e2c9-4185-a786-ccb61aa1d03f req-3bfb81e1-b5b9-4a5b-b3ff-519788cc7270 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-805a8541-29eb-4d41-8392-d7b94534558b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:18 devstack sudo[102187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-805a8541-29eb-4d41-8392-d7b94534558b
Jul 03 13:17:18 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:18 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-48c7b49b-7f71-4f9b-8143-659d72beb30d tempest-ProjectReaderTests-1655873210 None] Acquiring lock "cinder-10f69d74-e568-45dc-ae6b-1052cb4f7c55-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:17:18 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-48c7b49b-7f71-4f9b-8143-659d72beb30d tempest-ProjectReaderTests-1655873210 None] Lock "cinder-10f69d74-e568-45dc-ae6b-1052cb4f7c55-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:17:19 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-48c7b49b-7f71-4f9b-8143-659d72beb30d tempest-ProjectReaderTests-1655873210 None] Acquiring lock "cinder-quobyte-10f69d74-e568-45dc-ae6b-1052cb4f7c55" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:17:19 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-48c7b49b-7f71-4f9b-8143-659d72beb30d tempest-ProjectReaderTests-1655873210 None] Lock "cinder-quobyte-10f69d74-e568-45dc-ae6b-1052cb4f7c55" acquired by "delete_volume" :: waited 0.020s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:17:19 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46241ca-885d-4106-9a75-3688e0ac5e0e]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:17:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-48c7b49b-7f71-4f9b-8143-659d72beb30d tempest-ProjectReaderTests-1655873210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-10f69d74-e568-45dc-ae6b-1052cb4f7c55 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:19 devstack sudo[102189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-10f69d74-e568-45dc-ae6b-1052cb4f7c55
Jul 03 13:17:19 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:19 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-1fda6204-e2c9-4185-a786-ccb61aa1d03f req-3bfb81e1-b5b9-4a5b-b3ff-519788cc7270 tempest-TestServerVolumeAttachmentScenario-2110006989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-805a8541-29eb-4d41-8392-d7b94534558b" returned: 0 in 1.008s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-1fda6204-e2c9-4185-a786-ccb61aa1d03f req-3bfb81e1-b5b9-4a5b-b3ff-519788cc7270 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.028s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:17:19 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-1fda6204-e2c9-4185-a786-ccb61aa1d03f req-3bfb81e1-b5b9-4a5b-b3ff-519788cc7270 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db', 'name': 'volume-805a8541-29eb-4d41-8392-d7b94534558b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1b018c43-b858-4bce-bc5d-ab1bddccd8e6', 'enforce_multipath': True} {{(pid=86837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 13:17:19 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-1fda6204-e2c9-4185-a786-ccb61aa1d03f req-3bfb81e1-b5b9-4a5b-b3ff-519788cc7270 tempest-TestServerVolumeAttachmentScenario-2110006989 None] attachment_update completed successfully.
Jul 03 13:17:19 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-48c7b49b-7f71-4f9b-8143-659d72beb30d tempest-ProjectReaderTests-1655873210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-10f69d74-e568-45dc-ae6b-1052cb4f7c55" returned: 0 in 0.845s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-48c7b49b-7f71-4f9b-8143-659d72beb30d tempest-ProjectReaderTests-1655873210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-10f69d74-e568-45dc-ae6b-1052cb4f7c55 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:19 devstack sudo[102197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-10f69d74-e568-45dc-ae6b-1052cb4f7c55
Jul 03 13:17:19 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:20 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-48c7b49b-7f71-4f9b-8143-659d72beb30d tempest-ProjectReaderTests-1655873210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-10f69d74-e568-45dc-ae6b-1052cb4f7c55" returned: 0 in 0.847s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-48c7b49b-7f71-4f9b-8143-659d72beb30d tempest-ProjectReaderTests-1655873210 None] Lock "cinder-quobyte-10f69d74-e568-45dc-ae6b-1052cb4f7c55" released by "delete_volume" :: held 1.756s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:17:20 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-48c7b49b-7f71-4f9b-8143-659d72beb30d tempest-ProjectReaderTests-1655873210 None] Created reservations ['3366089a-2ed7-44d5-a2fe-f8111341fe6b', 'a41bffd7-7a70-487f-ade2-a2b928cf7ea3', '50d12f48-d368-4c68-992e-fd61d07a0b4c', 'dd3185ab-9908-47eb-a114-6316df813c9b'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:17:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-48c7b49b-7f71-4f9b-8143-659d72beb30d tempest-ProjectReaderTests-1655873210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:17:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-48c7b49b-7f71-4f9b-8143-659d72beb30d tempest-ProjectReaderTests-1655873210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:17:21 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-48c7b49b-7f71-4f9b-8143-659d72beb30d tempest-ProjectReaderTests-1655873210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:17:21 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-48c7b49b-7f71-4f9b-8143-659d72beb30d tempest-ProjectReaderTests-1655873210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:17:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-48c7b49b-7f71-4f9b-8143-659d72beb30d tempest-ProjectReaderTests-1655873210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:17:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-48c7b49b-7f71-4f9b-8143-659d72beb30d tempest-ProjectReaderTests-1655873210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:21 devstack sudo[102583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:17:21 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:21 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:17:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Flow 'volume_create_manager' (e59951ae-3950-4f50-9417-b83aebb5d693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:17:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c39aaad1-62bf-46df-90e3-0b0c1e5abe84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c39aaad1-62bf-46df-90e3-0b0c1e5abe84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-844785641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7664415-4583-4d5e-a038-60f81c1ddab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de1f9ed4f813449681f94b6fc4256ac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:17:22Z,use_quota=True,user_id='21a8d514cc53416484031152488505cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c609e922-3ede-4d12-a68a-8ca800cb5639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c609e922-3ede-4d12-a68a-8ca800cb5639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40c96b04-80ce-438c-adb7-56f76a0c65ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40c96b04-80ce-438c-adb7-56f76a0c65ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7664415-4583-4d5e-a038-60f81c1ddab0', 'volume_name': 'volume-f7664415-4583-4d5e-a038-60f81c1ddab0', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f2c2db-7f3a-488b-99b8-99f00f2cc7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f2c2db-7f3a-488b-99b8-99f00f2cc7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26abcbe6-2abd-45ba-967b-2bf2c9bbdb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:22 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Volume f7664415-4583-4d5e-a038-60f81c1ddab0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7664415-4583-4d5e-a038-60f81c1ddab0', 'volume_size': 1}
Jul 03 13:17:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:17:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:17:22 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-844785641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7664415-4583-4d5e-a038-60f81c1ddab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de1f9ed4f813449681f94b6fc4256ac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:17:22Z,use_quota=True,user_id='21a8d514cc53416484031152488505cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:17:22 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Creating volume f7664415-4583-4d5e-a038-60f81c1ddab0 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:17:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:17:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:17:22 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:17:22 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:22 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:17:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:17:22 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:17:22 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:17:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7664415-4583-4d5e-a038-60f81c1ddab0 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-48c7b49b-7f71-4f9b-8143-659d72beb30d tempest-ProjectReaderTests-1655873210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.001s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:22 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-48c7b49b-7f71-4f9b-8143-659d72beb30d tempest-ProjectReaderTests-1655873210 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:17:22 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-48c7b49b-7f71-4f9b-8143-659d72beb30d tempest-ProjectReaderTests-1655873210 None] Deleted volume successfully.
Jul 03 13:17:22 devstack sudo[102620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7664415-4583-4d5e-a038-60f81c1ddab0 1073741824
Jul 03 13:17:22 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:22 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-48c7b49b-7f71-4f9b-8143-659d72beb30d tempest-ProjectReaderTests-1655873210 None] Lock "cinder-10f69d74-e568-45dc-ae6b-1052cb4f7c55-delete_volume" released by "delete_volume" :: held 3.165s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:17:23 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7664415-4583-4d5e-a038-60f81c1ddab0 1073741824" returned: 0 in 1.120s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:23 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=68,cinder:INSERT=23,cinder:UPDATE=85,cinder:DELETE=7 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:17:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7664415-4583-4d5e-a038-60f81c1ddab0 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:23 devstack sudo[102634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7664415-4583-4d5e-a038-60f81c1ddab0
Jul 03 13:17:23 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:24 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7664415-4583-4d5e-a038-60f81c1ddab0" returned: 0 in 1.044s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] <== create_volume: return (2235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:17:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.241s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:17:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26abcbe6-2abd-45ba-967b-2bf2c9bbdb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7664415-4583-4d5e-a038-60f81c1ddab0', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d37b6dc-4e42-4ced-bb4e-ab3edf8d4592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:24 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Volume volume-f7664415-4583-4d5e-a038-60f81c1ddab0 (f7664415-4583-4d5e-a038-60f81c1ddab0): created successfully
Jul 03 13:17:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d37b6dc-4e42-4ced-bb4e-ab3edf8d4592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Flow 'volume_create_manager' (e59951ae-3950-4f50-9417-b83aebb5d693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:17:24 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-aa4d8d78-d951-4fd1-9146-e4f5b5288df4 tempest-ProjectReaderTests-1655873210 None] Created volume successfully.
Jul 03 13:17:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a9dc3854-ccf8-4e08-aa64-91fb47a57c00 tempest-ProjectReaderTests-1655873210 None] Acquiring lock "cinder-f7664415-4583-4d5e-a038-60f81c1ddab0-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:17:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a9dc3854-ccf8-4e08-aa64-91fb47a57c00 tempest-ProjectReaderTests-1655873210 None] Lock "cinder-f7664415-4583-4d5e-a038-60f81c1ddab0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:17:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a9dc3854-ccf8-4e08-aa64-91fb47a57c00 tempest-ProjectReaderTests-1655873210 None] Acquiring lock "cinder-quobyte-f7664415-4583-4d5e-a038-60f81c1ddab0" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:17:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a9dc3854-ccf8-4e08-aa64-91fb47a57c00 tempest-ProjectReaderTests-1655873210 None] Lock "cinder-quobyte-f7664415-4583-4d5e-a038-60f81c1ddab0" acquired by "delete_volume" :: waited 0.019s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:17:25 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cacfe23-abdb-40f3-92eb-ffe8fc4d25c9]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:17:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a9dc3854-ccf8-4e08-aa64-91fb47a57c00 tempest-ProjectReaderTests-1655873210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7664415-4583-4d5e-a038-60f81c1ddab0 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:25 devstack sudo[102637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7664415-4583-4d5e-a038-60f81c1ddab0
Jul 03 13:17:25 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:26 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a9dc3854-ccf8-4e08-aa64-91fb47a57c00 tempest-ProjectReaderTests-1655873210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7664415-4583-4d5e-a038-60f81c1ddab0" returned: 0 in 1.037s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a9dc3854-ccf8-4e08-aa64-91fb47a57c00 tempest-ProjectReaderTests-1655873210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7664415-4583-4d5e-a038-60f81c1ddab0 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:26 devstack sudo[102642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7664415-4583-4d5e-a038-60f81c1ddab0
Jul 03 13:17:26 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:27 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a9dc3854-ccf8-4e08-aa64-91fb47a57c00 tempest-ProjectReaderTests-1655873210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7664415-4583-4d5e-a038-60f81c1ddab0" returned: 0 in 0.878s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:27 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a9dc3854-ccf8-4e08-aa64-91fb47a57c00 tempest-ProjectReaderTests-1655873210 None] Lock "cinder-quobyte-f7664415-4583-4d5e-a038-60f81c1ddab0" released by "delete_volume" :: held 1.978s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:17:27 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-a9dc3854-ccf8-4e08-aa64-91fb47a57c00 tempest-ProjectReaderTests-1655873210 None] Created reservations ['a1d25745-6991-4ccc-b6c5-06679198dd48', '491dfa2e-beea-44d2-8554-73bbd4e6e2a6', '95bd2760-46e1-4094-8a6e-8522418d30a3', '6cd1bf5e-50f5-4d2d-8f4e-81604ecffa26'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:17:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a9dc3854-ccf8-4e08-aa64-91fb47a57c00 tempest-ProjectReaderTests-1655873210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:17:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a9dc3854-ccf8-4e08-aa64-91fb47a57c00 tempest-ProjectReaderTests-1655873210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:17:27 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc3854-ccf8-4e08-aa64-91fb47a57c00 tempest-ProjectReaderTests-1655873210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:17:27 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc3854-ccf8-4e08-aa64-91fb47a57c00 tempest-ProjectReaderTests-1655873210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:17:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a9dc3854-ccf8-4e08-aa64-91fb47a57c00 tempest-ProjectReaderTests-1655873210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:17:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a9dc3854-ccf8-4e08-aa64-91fb47a57c00 tempest-ProjectReaderTests-1655873210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:27 devstack sudo[102645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:17:27 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:28 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a9dc3854-ccf8-4e08-aa64-91fb47a57c00 tempest-ProjectReaderTests-1655873210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.906s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:28 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-a9dc3854-ccf8-4e08-aa64-91fb47a57c00 tempest-ProjectReaderTests-1655873210 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:17:28 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-a9dc3854-ccf8-4e08-aa64-91fb47a57c00 tempest-ProjectReaderTests-1655873210 None] Deleted volume successfully.
Jul 03 13:17:28 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a9dc3854-ccf8-4e08-aa64-91fb47a57c00 tempest-ProjectReaderTests-1655873210 None] Lock "cinder-f7664415-4583-4d5e-a038-60f81c1ddab0-delete_volume" released by "delete_volume" :: held 3.213s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:17:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-c25036c6-97a3-470f-b986-5be392eefd0b req-715a5243-6a10-4d19-8036-a257465357de tempest-TestServerVolumeAttachmentScenario-2110006989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:17:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-c25036c6-97a3-470f-b986-5be392eefd0b req-715a5243-6a10-4d19-8036-a257465357de tempest-TestServerVolumeAttachmentScenario-2110006989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:17:31 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c8cb62-b307-4edd-a796-927c79765702]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:17:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-c25036c6-97a3-470f-b986-5be392eefd0b req-715a5243-6a10-4d19-8036-a257465357de tempest-TestServerVolumeAttachmentScenario-2110006989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3cf677b3-6c16-4bb4-b57a-2e74c1a83af7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:31 devstack sudo[102660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3cf677b3-6c16-4bb4-b57a-2e74c1a83af7
Jul 03 13:17:31 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:32 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-c25036c6-97a3-470f-b986-5be392eefd0b req-715a5243-6a10-4d19-8036-a257465357de tempest-TestServerVolumeAttachmentScenario-2110006989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3cf677b3-6c16-4bb4-b57a-2e74c1a83af7" returned: 0 in 0.858s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-c25036c6-97a3-470f-b986-5be392eefd0b req-715a5243-6a10-4d19-8036-a257465357de tempest-TestServerVolumeAttachmentScenario-2110006989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.884s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:17:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-c25036c6-97a3-470f-b986-5be392eefd0b req-715a5243-6a10-4d19-8036-a257465357de tempest-TestServerVolumeAttachmentScenario-2110006989 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db', 'name': 'volume-3cf677b3-6c16-4bb4-b57a-2e74c1a83af7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61a5bd5b-fd05-45ed-af4f-0727ef3cb648', 'enforce_multipath': True} {{(pid=86837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 13:17:32 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-c25036c6-97a3-470f-b986-5be392eefd0b req-715a5243-6a10-4d19-8036-a257465357de tempest-TestServerVolumeAttachmentScenario-2110006989 None] attachment_update completed successfully.
Jul 03 13:17:34 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:17:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Flow 'volume_create_manager' (e607a7e1-dcac-4fcc-b018-24c7f4317a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:17:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90071f9c-411a-4bba-b457-03be01209d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90071f9c-411a-4bba-b457-03be01209d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-686406998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b333d000-62f0-4c9e-b7cb-a40f17b4b335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4931240054541e8938ed53aaaa7425c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:17:35Z,use_quota=True,user_id='8e1d84aa41744062a01cc28e0abb6e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38924695-6857-455f-933b-e8f35b73dd99),volume_type_id=38924695-6857-455f-933b-e8f35b73dd99)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3b3653e-b720-441b-b501-8989a58aca37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3b3653e-b720-441b-b501-8989a58aca37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f6c904-ff8a-47a1-8b31-c07d028fe8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f6c904-ff8a-47a1-8b31-c07d028fe8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b333d000-62f0-4c9e-b7cb-a40f17b4b335', 'volume_name': 'volume-b333d000-62f0-4c9e-b7cb-a40f17b4b335', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4fe51cc-4ee8-47f3-beaa-30b736b366d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4fe51cc-4ee8-47f3-beaa-30b736b366d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (165cf742-397d-4fa8-b0ba-16fafdb348ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:34 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Volume b333d000-62f0-4c9e-b7cb-a40f17b4b335: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b333d000-62f0-4c9e-b7cb-a40f17b4b335', 'volume_size': 1}
Jul 03 13:17:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:17:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:17:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-686406998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b333d000-62f0-4c9e-b7cb-a40f17b4b335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4931240054541e8938ed53aaaa7425c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:17:35Z,use_quota=True,user_id='8e1d84aa41744062a01cc28e0abb6e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38924695-6857-455f-933b-e8f35b73dd99),volume_type_id=38924695-6857-455f-933b-e8f35b73dd99)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:17:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Creating volume b333d000-62f0-4c9e-b7cb-a40f17b4b335 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:17:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:17:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:17:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:17:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:17:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:17:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:17:34 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:17:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b333d000-62f0-4c9e-b7cb-a40f17b4b335 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:34 devstack sudo[102669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b333d000-62f0-4c9e-b7cb-a40f17b4b335 1073741824
Jul 03 13:17:34 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:35 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:17:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Flow 'volume_create_manager' (14ac1bc2-08d5-4f62-818d-1bd42dd37a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:17:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0bd555-b34f-4f7d-99d6-86d0f6137de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0bd555-b34f-4f7d-99d6-86d0f6137de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-964053454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=773073d0-a056-4d59-8817-e339d54e678e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4931240054541e8938ed53aaaa7425c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:17:35Z,use_quota=True,user_id='8e1d84aa41744062a01cc28e0abb6e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4df3cddc-2902-42f8-b8b9-083421d21ae0),volume_type_id=4df3cddc-2902-42f8-b8b9-083421d21ae0)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0608b00d-9bdc-4c35-b86c-048c6cc1cd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0608b00d-9bdc-4c35-b86c-048c6cc1cd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9d2a1a-0d48-49ab-b307-a1ed2deee2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9d2a1a-0d48-49ab-b307-a1ed2deee2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '773073d0-a056-4d59-8817-e339d54e678e', 'volume_name': 'volume-773073d0-a056-4d59-8817-e339d54e678e', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de53ed79-8816-4734-a3f2-a137f7d17ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de53ed79-8816-4734-a3f2-a137f7d17ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef2a3366-84ac-4f8b-be0e-df805b992beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:35 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Volume 773073d0-a056-4d59-8817-e339d54e678e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-773073d0-a056-4d59-8817-e339d54e678e', 'volume_size': 1}
Jul 03 13:17:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:17:35 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b333d000-62f0-4c9e-b7cb-a40f17b4b335 1073741824" returned: 0 in 0.988s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:35 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:17:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Flow 'volume_create_manager' (f9bb2a06-464b-498c-bbeb-b2b54c285bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:17:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03647170-956d-4b8d-9b44-053c51509353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03647170-956d-4b8d-9b44-053c51509353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1061475458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8291c43f-bc84-49ad-a7d1-36f8db80ccf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4931240054541e8938ed53aaaa7425c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:17:36Z,use_quota=True,user_id='8e1d84aa41744062a01cc28e0abb6e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e160cd2-e876-4e6b-b413-2a4064b3e0f2),volume_type_id=7e160cd2-e876-4e6b-b413-2a4064b3e0f2)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7176ef1-a74c-41a5-8066-3b1d971ad7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7176ef1-a74c-41a5-8066-3b1d971ad7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c926a85-9f57-455b-a77c-13915bc71c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:35 devstack cinder-volume[86837]: DEBUG cinder.image.glance [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Creating Keystone auth plugin from conf {{(pid=86837) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 13:17:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b333d000-62f0-4c9e-b7cb-a40f17b4b335 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:35 devstack sudo[102675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b333d000-62f0-4c9e-b7cb-a40f17b4b335
Jul 03 13:17:35 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c926a85-9f57-455b-a77c-13915bc71c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8291c43f-bc84-49ad-a7d1-36f8db80ccf6', 'volume_name': 'volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6', 'volume_size': 1, 'image_id': 'ac09d922-5cab-406c-bb48-acb1dc2cd963', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ac09d922-5cab-406c-bb48-acb1dc2cd963', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--237352884', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4931240054541e8938ed53aaaa7425c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ac09d922-5cab-406c-bb48-acb1dc2cd963', 'created_at': datetime.datetime(2026, 7, 3, 11, 17, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 17, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ac09d922-5cab-406c-bb48-acb1dc2cd963/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7aa53c050e60>}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03eeb8fd-eb4a-4929-b998-bcf0fb80e468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03eeb8fd-eb4a-4929-b998-bcf0fb80e468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c31da6e-c49f-4039-be49-51d639bd4f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:36 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Volume 8291c43f-bc84-49ad-a7d1-36f8db80ccf6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6', 'volume_size': 1, 'image_id': 'ac09d922-5cab-406c-bb48-acb1dc2cd963', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ac09d922-5cab-406c-bb48-acb1dc2cd963', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--237352884', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4931240054541e8938ed53aaaa7425c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ac09d922-5cab-406c-bb48-acb1dc2cd963', 'created_at': datetime.datetime(2026, 7, 3, 11, 17, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 17, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ac09d922-5cab-406c-bb48-acb1dc2cd963/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7aa53c050e60>}
Jul 03 13:17:36 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Trying to clone 8291c43f-bc84-49ad-a7d1-36f8db80ccf6 from image ac09d922-5cab-406c-bb48-acb1dc2cd963 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ac09d922-5cab-406c-bb48-acb1dc2cd963', 'metadata': {}}]). {{(pid=86837) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 03 13:17:36 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b333d000-62f0-4c9e-b7cb-a40f17b4b335" returned: 0 in 0.839s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:17:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:17:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.426s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:17:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-964053454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=773073d0-a056-4d59-8817-e339d54e678e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4931240054541e8938ed53aaaa7425c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:17:35Z,use_quota=True,user_id='8e1d84aa41744062a01cc28e0abb6e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4df3cddc-2902-42f8-b8b9-083421d21ae0),volume_type_id=4df3cddc-2902-42f8-b8b9-083421d21ae0)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:17:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Creating volume 773073d0-a056-4d59-8817-e339d54e678e {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:17:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:17:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:17:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:17:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:17:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:17:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:17:36 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:17:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-773073d0-a056-4d59-8817-e339d54e678e 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (165cf742-397d-4fa8-b0ba-16fafdb348ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b333d000-62f0-4c9e-b7cb-a40f17b4b335', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:36 devstack sudo[102678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-773073d0-a056-4d59-8817-e339d54e678e 1073741824
Jul 03 13:17:36 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c61fe5c-c5c1-454a-9ab6-ef80bec0b2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:36 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Volume volume-b333d000-62f0-4c9e-b7cb-a40f17b4b335 (b333d000-62f0-4c9e-b7cb-a40f17b4b335): created successfully
Jul 03 13:17:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c61fe5c-c5c1-454a-9ab6-ef80bec0b2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Flow 'volume_create_manager' (e607a7e1-dcac-4fcc-b018-24c7f4317a9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:17:36 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-bc5c6849-1bd4-4938-bc94-55a646bc809f tempest-TestInstancesWithCinderVolumes-843868558 None] Created volume successfully.
Jul 03 13:17:37 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-773073d0-a056-4d59-8817-e339d54e678e 1073741824" returned: 0 in 0.932s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-773073d0-a056-4d59-8817-e339d54e678e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:37 devstack sudo[102684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-773073d0-a056-4d59-8817-e339d54e678e
Jul 03 13:17:37 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:38 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-773073d0-a056-4d59-8817-e339d54e678e" returned: 0 in 0.731s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:38 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:17:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:17:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef2a3366-84ac-4f8b-be0e-df805b992beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-773073d0-a056-4d59-8817-e339d54e678e', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d7a614-de6c-4a01-83d1-aeeead06a0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:38 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Volume volume-773073d0-a056-4d59-8817-e339d54e678e (773073d0-a056-4d59-8817-e339d54e678e): created successfully
Jul 03 13:17:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d7a614-de6c-4a01-83d1-aeeead06a0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Flow 'volume_create_manager' (14ac1bc2-08d5-4f62-818d-1bd42dd37a6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:17:38 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-6d25e985-de7d-445a-aea5-4f351d4cc160 tempest-TestInstancesWithCinderVolumes-843868558 None] Created volume successfully.
Jul 03 13:17:39 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-f8f01aa6-5e27-44fb-ae9a-75d83387dec3 req-0b50af8a-d222-496f-8a9e-b4ca9e19e0ab tempest-TestServerVolumeAttachmentScenario-2110006989 None] Terminate volume connection completed successfully.
Jul 03 13:17:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-f8f01aa6-5e27-44fb-ae9a-75d83387dec3 req-0b50af8a-d222-496f-8a9e-b4ca9e19e0ab tempest-TestServerVolumeAttachmentScenario-2110006989 None] Deleting attachment 61a5bd5b-fd05-45ed-af4f-0727ef3cb648. {{(pid=86837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:17:39 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ac09d922-5cab-406c-bb48-acb1dc2cd963_wxj2gfqmdevstack@QuobyteHD, size 20.69 MB, duration 3.53 sec {{(pid=86837) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 03 13:17:39 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Image download 20.69 MB at 5.86 MB/s
Jul 03 13:17:39 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c661951-ebb8-49e6-b852-6e6785f91d5d]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:17:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ac09d922-5cab-406c-bb48-acb1dc2cd963_wxj2gfqmdevstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:39 devstack sudo[102689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ac09d922-5cab-406c-bb48-acb1dc2cd963_wxj2gfqmdevstack@QuobyteHD
Jul 03 13:17:39 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:40 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ac09d922-5cab-406c-bb48-acb1dc2cd963_wxj2gfqmdevstack@QuobyteHD" returned: 0 in 0.742s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:40 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Temporary image ac09d922-5cab-406c-bb48-acb1dc2cd963 is fetched for user 8e1d84aa41744062a01cc28e0abb6e1d. {{(pid=86837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 03 13:17:40 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cfe7c0-1623-49de-88b6-084e13670df2]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:17:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ac09d922-5cab-406c-bb48-acb1dc2cd963_wxj2gfqmdevstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:40 devstack sudo[102718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ac09d922-5cab-406c-bb48-acb1dc2cd963_wxj2gfqmdevstack@QuobyteHD
Jul 03 13:17:40 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:41 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ac09d922-5cab-406c-bb48-acb1dc2cd963_wxj2gfqmdevstack@QuobyteHD" returned: 0 in 0.858s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:17:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:17:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1061475458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8291c43f-bc84-49ad-a7d1-36f8db80ccf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4931240054541e8938ed53aaaa7425c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:17:36Z,use_quota=True,user_id='8e1d84aa41744062a01cc28e0abb6e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e160cd2-e876-4e6b-b413-2a4064b3e0f2),volume_type_id=7e160cd2-e876-4e6b-b413-2a4064b3e0f2)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:17:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Creating volume 8291c43f-bc84-49ad-a7d1-36f8db80ccf6 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:17:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:17:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:17:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:17:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:17:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:17:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:17:41 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:17:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:41 devstack sudo[102723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6 1073741824
Jul 03 13:17:41 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:42 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6 1073741824" returned: 0 in 0.858s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:42 devstack sudo[102729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6
Jul 03 13:17:42 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:42 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6" returned: 0 in 0.701s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:42 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:17:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:17:43 devstack cinder-volume[86837]: DEBUG cinder.volume.volume_utils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Attempting download of ac09d922-5cab-406c-bb48-acb1dc2cd963 ((None, [{'url': 'file:///opt/stack/data/glance/images/ac09d922-5cab-406c-bb48-acb1dc2cd963', 'metadata': {}}])) to volume 8291c43f-bc84-49ad-a7d1-36f8db80ccf6. {{(pid=86837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 03 13:17:43 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d707363f-c59e-430b-92af-ad2b8f8e9891]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:17:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ac09d922-5cab-406c-bb48-acb1dc2cd963_558z32ko {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:43 devstack sudo[102733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ac09d922-5cab-406c-bb48-acb1dc2cd963_558z32ko
Jul 03 13:17:43 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:43 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-354a5468-520f-47f4-af30-b8c3ea8a4459 req-1dfef74b-d428-4478-a206-bc17010592f8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Terminate volume connection completed successfully.
Jul 03 13:17:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-354a5468-520f-47f4-af30-b8c3ea8a4459 req-1dfef74b-d428-4478-a206-bc17010592f8 tempest-TestServerVolumeAttachmentScenario-2110006989 None] Deleting attachment 1b018c43-b858-4bce-bc5d-ab1bddccd8e6. {{(pid=86837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:17:43 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ac09d922-5cab-406c-bb48-acb1dc2cd963_558z32ko" returned: 0 in 0.833s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ac09d922-5cab-406c-bb48-acb1dc2cd963_558z32ko {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:44 devstack sudo[102740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ac09d922-5cab-406c-bb48-acb1dc2cd963_558z32ko
Jul 03 13:17:44 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:44 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ac09d922-5cab-406c-bb48-acb1dc2cd963_558z32ko" returned: 1 in 0.827s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ac09d922-5cab-406c-bb48-acb1dc2cd963_558z32ko' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:17:44 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb60da5-2490-4fe9-85f0-7da9fd010d4b]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:17:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ac09d922-5cab-406c-bb48-acb1dc2cd963_wxj2gfqmdevstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:44 devstack sudo[102744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ac09d922-5cab-406c-bb48-acb1dc2cd963_wxj2gfqmdevstack@QuobyteHD
Jul 03 13:17:44 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:45 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ac09d922-5cab-406c-bb48-acb1dc2cd963_wxj2gfqmdevstack@QuobyteHD" returned: 0 in 0.851s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:45 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] ac09d922-5cab-406c-bb48-acb1dc2cd963 was qcow2, converting to raw {{(pid=86837) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 03 13:17:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ac09d922-5cab-406c-bb48-acb1dc2cd963_wxj2gfqmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:45 devstack sudo[102749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ac09d922-5cab-406c-bb48-acb1dc2cd963_wxj2gfqmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6
Jul 03 13:17:45 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:47 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ac09d922-5cab-406c-bb48-acb1dc2cd963_wxj2gfqmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6" returned: 0 in 2.377s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:47 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ac09d922-5cab-406c-bb48-acb1dc2cd963_wxj2gfqmdevstack@QuobyteHD, size 112.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6 {{(pid=86837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 13:17:47 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Converted 112.00 MB image at 47.09 MB/s
Jul 03 13:17:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:48 devstack sudo[102799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6 1G
Jul 03 13:17:48 devstack sudo[102799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:48 devstack sudo[102799]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6 1G" returned: 0 in 0.955s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:49 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e966c72-09b6-4e3f-8fc5-2f010b23b852]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:17:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:49 devstack sudo[102809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6
Jul 03 13:17:49 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:49 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6" returned: 0 in 0.824s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:49 devstack sudo[102813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6
Jul 03 13:17:49 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:50 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6" returned: 1 in 0.793s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:17:50 devstack cinder-volume[86837]: DEBUG cinder.volume.volume_utils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Downloaded image ac09d922-5cab-406c-bb48-acb1dc2cd963 ((None, [{'url': 'file:///opt/stack/data/glance/images/ac09d922-5cab-406c-bb48-acb1dc2cd963', 'metadata': {}}])) to volume 8291c43f-bc84-49ad-a7d1-36f8db80ccf6 successfully. {{(pid=86837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 03 13:17:50 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Temporary image ac09d922-5cab-406c-bb48-acb1dc2cd963 for user 8e1d84aa41744062a01cc28e0abb6e1d is deleted. {{(pid=86837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 03 13:17:50 devstack cinder-volume[86837]: DEBUG cinder.volume.volume_utils [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Marking volume 8291c43f-bc84-49ad-a7d1-36f8db80ccf6 as bootable. {{(pid=86837) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 03 13:17:50 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Copying metadata from image ac09d922-5cab-406c-bb48-acb1dc2cd963 to 8291c43f-bc84-49ad-a7d1-36f8db80ccf6. {{(pid=86837) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 13:17:50 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Creating volume glance metadata for volume 8291c43f-bc84-49ad-a7d1-36f8db80ccf6 backed by image ac09d922-5cab-406c-bb48-acb1dc2cd963 with: {'image_id': 'ac09d922-5cab-406c-bb48-acb1dc2cd963', 'image_name': 'tempest-scenario-img--237352884', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86837) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 13:17:50 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c31da6e-c49f-4039-be49-51d639bd4f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6', 'volume_size': 1, 'image_id': 'ac09d922-5cab-406c-bb48-acb1dc2cd963', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ac09d922-5cab-406c-bb48-acb1dc2cd963', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--237352884', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4931240054541e8938ed53aaaa7425c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ac09d922-5cab-406c-bb48-acb1dc2cd963', 'created_at': datetime.datetime(2026, 7, 3, 11, 17, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 17, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ac09d922-5cab-406c-bb48-acb1dc2cd963/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7aa53c050e60>}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:50 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c53414b6-976b-4740-a69a-5c6ffe75b109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:17:50 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Volume volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6 (8291c43f-bc84-49ad-a7d1-36f8db80ccf6): created successfully
Jul 03 13:17:50 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c53414b6-976b-4740-a69a-5c6ffe75b109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:17:50 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Flow 'volume_create_manager' (f9bb2a06-464b-498c-bbeb-b2b54c285bbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:17:50 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-dce64b95-b7eb-4a70-9629-05ada6eec167 tempest-TestInstancesWithCinderVolumes-843868558 None] Created volume successfully.
Jul 03 13:17:54 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8a87a088-1aab-4ef5-91ac-9ed52d7b8cfa tempest-TestServerVolumeAttachmentScenario-2110006989 None] Acquiring lock "cinder-3cf677b3-6c16-4bb4-b57a-2e74c1a83af7-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:17:54 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8a87a088-1aab-4ef5-91ac-9ed52d7b8cfa tempest-TestServerVolumeAttachmentScenario-2110006989 None] Lock "cinder-3cf677b3-6c16-4bb4-b57a-2e74c1a83af7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:17:54 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=74,cinder:INSERT=26,cinder:UPDATE=93,cinder:DELETE=6 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:17:54 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8a87a088-1aab-4ef5-91ac-9ed52d7b8cfa tempest-TestServerVolumeAttachmentScenario-2110006989 None] Acquiring lock "cinder-quobyte-3cf677b3-6c16-4bb4-b57a-2e74c1a83af7" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:17:54 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8a87a088-1aab-4ef5-91ac-9ed52d7b8cfa tempest-TestServerVolumeAttachmentScenario-2110006989 None] Lock "cinder-quobyte-3cf677b3-6c16-4bb4-b57a-2e74c1a83af7" acquired by "delete_volume" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:17:54 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fa069b-78c9-4588-8033-6eddcc05adc2]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:17:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8a87a088-1aab-4ef5-91ac-9ed52d7b8cfa tempest-TestServerVolumeAttachmentScenario-2110006989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3cf677b3-6c16-4bb4-b57a-2e74c1a83af7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:54 devstack sudo[102822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3cf677b3-6c16-4bb4-b57a-2e74c1a83af7
Jul 03 13:17:54 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:55 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8a87a088-1aab-4ef5-91ac-9ed52d7b8cfa tempest-TestServerVolumeAttachmentScenario-2110006989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3cf677b3-6c16-4bb4-b57a-2e74c1a83af7" returned: 0 in 0.804s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8a87a088-1aab-4ef5-91ac-9ed52d7b8cfa tempest-TestServerVolumeAttachmentScenario-2110006989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3cf677b3-6c16-4bb4-b57a-2e74c1a83af7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:55 devstack sudo[102827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3cf677b3-6c16-4bb4-b57a-2e74c1a83af7
Jul 03 13:17:55 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:55 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8a87a088-1aab-4ef5-91ac-9ed52d7b8cfa tempest-TestServerVolumeAttachmentScenario-2110006989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3cf677b3-6c16-4bb4-b57a-2e74c1a83af7" returned: 0 in 0.739s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8a87a088-1aab-4ef5-91ac-9ed52d7b8cfa tempest-TestServerVolumeAttachmentScenario-2110006989 None] Lock "cinder-quobyte-3cf677b3-6c16-4bb4-b57a-2e74c1a83af7" released by "delete_volume" :: held 1.592s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:17:55 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-8a87a088-1aab-4ef5-91ac-9ed52d7b8cfa tempest-TestServerVolumeAttachmentScenario-2110006989 None] Created reservations ['84ccc6b1-fff7-4858-af2d-7801c3d80eb7', 'c9d3ce08-993f-41ce-90c0-d8179f0332d0', 'db29351d-c296-4e4a-877b-9f4925148957', 'bca3d417-62da-4974-804c-4a3abefd24f1'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:17:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8a87a088-1aab-4ef5-91ac-9ed52d7b8cfa tempest-TestServerVolumeAttachmentScenario-2110006989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:17:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8a87a088-1aab-4ef5-91ac-9ed52d7b8cfa tempest-TestServerVolumeAttachmentScenario-2110006989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:17:55 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8a87a088-1aab-4ef5-91ac-9ed52d7b8cfa tempest-TestServerVolumeAttachmentScenario-2110006989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:17:55 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8a87a088-1aab-4ef5-91ac-9ed52d7b8cfa tempest-TestServerVolumeAttachmentScenario-2110006989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:17:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8a87a088-1aab-4ef5-91ac-9ed52d7b8cfa tempest-TestServerVolumeAttachmentScenario-2110006989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:17:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8a87a088-1aab-4ef5-91ac-9ed52d7b8cfa tempest-TestServerVolumeAttachmentScenario-2110006989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:55 devstack sudo[102830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:17:55 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:56 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-38973762-e501-468b-af29-d146a4bab63b tempest-TestServerVolumeAttachmentScenario-2110006989 None] Acquiring lock "cinder-805a8541-29eb-4d41-8392-d7b94534558b-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:17:56 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-38973762-e501-468b-af29-d146a4bab63b tempest-TestServerVolumeAttachmentScenario-2110006989 None] Lock "cinder-805a8541-29eb-4d41-8392-d7b94534558b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:17:56 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-38973762-e501-468b-af29-d146a4bab63b tempest-TestServerVolumeAttachmentScenario-2110006989 None] Acquiring lock "cinder-quobyte-805a8541-29eb-4d41-8392-d7b94534558b" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:17:56 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-38973762-e501-468b-af29-d146a4bab63b tempest-TestServerVolumeAttachmentScenario-2110006989 None] Lock "cinder-quobyte-805a8541-29eb-4d41-8392-d7b94534558b" acquired by "delete_volume" :: waited 0.024s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:17:56 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ba9f1f-1686-4faf-bf3c-754f03ee9240]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:17:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-38973762-e501-468b-af29-d146a4bab63b tempest-TestServerVolumeAttachmentScenario-2110006989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-805a8541-29eb-4d41-8392-d7b94534558b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:56 devstack sudo[102832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-805a8541-29eb-4d41-8392-d7b94534558b
Jul 03 13:17:56 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:56 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8a87a088-1aab-4ef5-91ac-9ed52d7b8cfa tempest-TestServerVolumeAttachmentScenario-2110006989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.749s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:56 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-8a87a088-1aab-4ef5-91ac-9ed52d7b8cfa tempest-TestServerVolumeAttachmentScenario-2110006989 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:17:56 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-8a87a088-1aab-4ef5-91ac-9ed52d7b8cfa tempest-TestServerVolumeAttachmentScenario-2110006989 None] Deleted volume successfully.
Jul 03 13:17:56 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8a87a088-1aab-4ef5-91ac-9ed52d7b8cfa tempest-TestServerVolumeAttachmentScenario-2110006989 None] Lock "cinder-3cf677b3-6c16-4bb4-b57a-2e74c1a83af7-delete_volume" released by "delete_volume" :: held 2.609s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:17:57 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-38973762-e501-468b-af29-d146a4bab63b tempest-TestServerVolumeAttachmentScenario-2110006989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-805a8541-29eb-4d41-8392-d7b94534558b" returned: 0 in 0.936s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-38973762-e501-468b-af29-d146a4bab63b tempest-TestServerVolumeAttachmentScenario-2110006989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-805a8541-29eb-4d41-8392-d7b94534558b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:57 devstack sudo[102838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-805a8541-29eb-4d41-8392-d7b94534558b
Jul 03 13:17:57 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:58 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-38973762-e501-468b-af29-d146a4bab63b tempest-TestServerVolumeAttachmentScenario-2110006989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-805a8541-29eb-4d41-8392-d7b94534558b" returned: 0 in 0.925s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:58 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-38973762-e501-468b-af29-d146a4bab63b tempest-TestServerVolumeAttachmentScenario-2110006989 None] Lock "cinder-quobyte-805a8541-29eb-4d41-8392-d7b94534558b" released by "delete_volume" :: held 1.931s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:17:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-2a8a7c07-196d-475b-b019-9ae71ca49d21 req-2680edbd-bb3f-4035-84a8-2ddf617101b5 tempest-TestInstancesWithCinderVolumes-843868558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:17:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-2a8a7c07-196d-475b-b019-9ae71ca49d21 req-2680edbd-bb3f-4035-84a8-2ddf617101b5 tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:17:58 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[fada7d56-8696-48d3-9a4d-3dff8c6df96b]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:17:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-2a8a7c07-196d-475b-b019-9ae71ca49d21 req-2680edbd-bb3f-4035-84a8-2ddf617101b5 tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:58 devstack sudo[102852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6
Jul 03 13:17:58 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:58 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-38973762-e501-468b-af29-d146a4bab63b tempest-TestServerVolumeAttachmentScenario-2110006989 None] Created reservations ['0be24d0e-1780-4315-a506-90a442b679b9', 'acc7fc19-531e-484f-976c-3bc635d91428', '31a39748-7fa8-40b7-be91-06f4b4e6bd0e', '7faf5715-1dd0-41bb-ad8e-69aa492115ed'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:17:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-38973762-e501-468b-af29-d146a4bab63b tempest-TestServerVolumeAttachmentScenario-2110006989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:17:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-38973762-e501-468b-af29-d146a4bab63b tempest-TestServerVolumeAttachmentScenario-2110006989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:17:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-38973762-e501-468b-af29-d146a4bab63b tempest-TestServerVolumeAttachmentScenario-2110006989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:17:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-38973762-e501-468b-af29-d146a4bab63b tempest-TestServerVolumeAttachmentScenario-2110006989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:17:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-38973762-e501-468b-af29-d146a4bab63b tempest-TestServerVolumeAttachmentScenario-2110006989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:17:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-38973762-e501-468b-af29-d146a4bab63b tempest-TestServerVolumeAttachmentScenario-2110006989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:58 devstack sudo[102854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:17:58 devstack sudo[102854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:59 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-2a8a7c07-196d-475b-b019-9ae71ca49d21 req-2680edbd-bb3f-4035-84a8-2ddf617101b5 tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6" returned: 0 in 0.946s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-2a8a7c07-196d-475b-b019-9ae71ca49d21 req-2680edbd-bb3f-4035-84a8-2ddf617101b5 tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:17:59 devstack sudo[102858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6
Jul 03 13:17:59 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:17:59 devstack sudo[102854]: pam_unix(sudo:session): session closed for user root
Jul 03 13:17:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-38973762-e501-468b-af29-d146a4bab63b tempest-TestServerVolumeAttachmentScenario-2110006989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.956s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:17:59 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-38973762-e501-468b-af29-d146a4bab63b tempest-TestServerVolumeAttachmentScenario-2110006989 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:17:59 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-38973762-e501-468b-af29-d146a4bab63b tempest-TestServerVolumeAttachmentScenario-2110006989 None] Deleted volume successfully.
Jul 03 13:17:59 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-38973762-e501-468b-af29-d146a4bab63b tempest-TestServerVolumeAttachmentScenario-2110006989 None] Lock "cinder-805a8541-29eb-4d41-8392-d7b94534558b-delete_volume" released by "delete_volume" :: held 3.417s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:18:00 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root
Jul 03 13:18:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-2a8a7c07-196d-475b-b019-9ae71ca49d21 req-2680edbd-bb3f-4035-84a8-2ddf617101b5 tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6" returned: 1 in 0.900s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:18:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-2a8a7c07-196d-475b-b019-9ae71ca49d21 req-2680edbd-bb3f-4035-84a8-2ddf617101b5 tempest-TestInstancesWithCinderVolumes-843868558 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:18:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-2a8a7c07-196d-475b-b019-9ae71ca49d21 req-2680edbd-bb3f-4035-84a8-2ddf617101b5 tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.893s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:18:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-2a8a7c07-196d-475b-b019-9ae71ca49d21 req-2680edbd-bb3f-4035-84a8-2ddf617101b5 tempest-TestInstancesWithCinderVolumes-843868558 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db', 'name': 'volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e929ac03-932f-4e20-8efa-76d14114ca8e', 'enforce_multipath': True} {{(pid=86837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 13:18:00 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-2a8a7c07-196d-475b-b019-9ae71ca49d21 req-2680edbd-bb3f-4035-84a8-2ddf617101b5 tempest-TestInstancesWithCinderVolumes-843868558 None] attachment_update completed successfully.
Jul 03 13:18:10 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=12,cinder:INSERT=5,cinder:UPDATE=17,cinder:DELETE=2 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:18:10 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:UPDATE=37,cinder:DELETE=4,cinder:SELECT=42,cinder:INSERT=8 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:18:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:18:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:18:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:18:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:18:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:18:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:18:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:18:15 devstack sudo[103322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:18:15 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:18:16 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root
Jul 03 13:18:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.150s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:18:16 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:18:16 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:18:16 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 28 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:18:16 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>, <Thread(tpool_thread_0, started daemon 134850092431040)>, <Thread(tpool_thread_1, started daemon 134850084021952)>, <Thread(tpool_thread_2, started daemon 134850075612864)>, <Thread(tpool_thread_3, started daemon 134850067203776)>, <Thread(tpool_thread_4, started daemon 134850058794688)>, <Thread(tpool_thread_5, started daemon 134850050385600)>, <Thread(tpool_thread_6, started daemon 134850041976512)>, <Thread(tpool_thread_7, started daemon 134850033567424)>, <Thread(tpool_thread_8, started daemon 134850025158336)>, <Thread(tpool_thread_9, started daemon 134850016749248)>, <Thread(tpool_thread_10, started daemon 134850008340160)>, <Thread(tpool_thread_11, started daemon 134849999931072)>, <Thread(tpool_thread_12, started daemon 134849991521984)>, <Thread(tpool_thread_13, started daemon 134849983112896)>, <Thread(tpool_thread_14, started daemon 134849974703808)>, <Thread(tpool_thread_15, started daemon 134849966294720)>, <Thread(tpool_thread_16, started daemon 134849957885632)>, <Thread(tpool_thread_17, started daemon 134849949476544)>, <Thread(tpool_thread_18, started daemon 134849941067456)>, <Thread(tpool_thread_19, started daemon 134849932658368)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:18:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-03bdf1c3-32a3-427f-8990-408572783685 req-f53f9780-d7c8-40e0-84d8-db9adacb585c tempest-TestInstancesWithCinderVolumes-843868558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:18:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-03bdf1c3-32a3-427f-8990-408572783685 req-f53f9780-d7c8-40e0-84d8-db9adacb585c tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:18:44 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[add6cfba-777f-4f5b-93e8-90e83f9f5311]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:18:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-03bdf1c3-32a3-427f-8990-408572783685 req-f53f9780-d7c8-40e0-84d8-db9adacb585c tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b333d000-62f0-4c9e-b7cb-a40f17b4b335 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:18:44 devstack sudo[103484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b333d000-62f0-4c9e-b7cb-a40f17b4b335
Jul 03 13:18:44 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:18:44 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:18:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Flow 'volume_create_manager' (93bb3050-0088-4ee0-b7b7-4dc6a22128e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:18:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9898f76c-a14c-4063-a4dd-c8c45f43c2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:18:45 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9898f76c-a14c-4063-a4dd-c8c45f43c2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1449455338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab466321-7a88-4b8f-8b2c-26932bbe7f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c322ed27656b485882604cb63d9939d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:18:45Z,use_quota=True,user_id='343be6d74b4d40debe02482960997ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:18:45 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a48fa13-1472-4244-8810-b895576e0d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:18:45 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a48fa13-1472-4244-8810-b895576e0d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:18:45 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9089e2da-d45c-4935-b05e-70006a80f95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:18:45 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9089e2da-d45c-4935-b05e-70006a80f95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab466321-7a88-4b8f-8b2c-26932bbe7f9d', 'volume_name': 'volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:18:45 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b9f7ecd-15b5-42aa-bd8f-190b312b3749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:18:45 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b9f7ecd-15b5-42aa-bd8f-190b312b3749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:18:45 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a061b5c6-0fa9-4db5-8073-546a6f98cc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:18:45 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Volume ab466321-7a88-4b8f-8b2c-26932bbe7f9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d', 'volume_size': 1}
Jul 03 13:18:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:18:45 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root
Jul 03 13:18:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-03bdf1c3-32a3-427f-8990-408572783685 req-f53f9780-d7c8-40e0-84d8-db9adacb585c tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b333d000-62f0-4c9e-b7cb-a40f17b4b335" returned: 0 in 1.016s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:18:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-03bdf1c3-32a3-427f-8990-408572783685 req-f53f9780-d7c8-40e0-84d8-db9adacb585c tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.042s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:18:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.599s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:18:45 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1449455338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab466321-7a88-4b8f-8b2c-26932bbe7f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c322ed27656b485882604cb63d9939d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:18:45Z,use_quota=True,user_id='343be6d74b4d40debe02482960997ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:18:45 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Creating volume ab466321-7a88-4b8f-8b2c-26932bbe7f9d {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:18:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:18:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:18:45 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:18:45 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:18:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:18:45 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:18:45 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:18:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:18:45 devstack sudo[103492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d 1073741824
Jul 03 13:18:45 devstack sudo[103492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:18:45 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-03bdf1c3-32a3-427f-8990-408572783685 req-f53f9780-d7c8-40e0-84d8-db9adacb585c tempest-TestInstancesWithCinderVolumes-843868558 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db', 'name': 'volume-b333d000-62f0-4c9e-b7cb-a40f17b4b335', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '28503879-7c19-454d-b9d2-05809056b7d7', 'enforce_multipath': True} {{(pid=86837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 13:18:45 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-03bdf1c3-32a3-427f-8990-408572783685 req-f53f9780-d7c8-40e0-84d8-db9adacb585c tempest-TestInstancesWithCinderVolumes-843868558 None] attachment_update completed successfully.
Jul 03 13:18:46 devstack sudo[103492]: pam_unix(sudo:session): session closed for user root
Jul 03 13:18:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d 1073741824" returned: 0 in 0.985s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:18:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:18:46 devstack sudo[103498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d
Jul 03 13:18:46 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:18:47 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root
Jul 03 13:18:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d" returned: 0 in 0.921s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:18:47 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] <== create_volume: return (1974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:18:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.977s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:18:47 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a061b5c6-0fa9-4db5-8073-546a6f98cc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:18:47 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34100413-2a76-4549-8a63-c0a5cbea02cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:18:47 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Volume volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d (ab466321-7a88-4b8f-8b2c-26932bbe7f9d): created successfully
Jul 03 13:18:47 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34100413-2a76-4549-8a63-c0a5cbea02cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:18:47 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Flow 'volume_create_manager' (93bb3050-0088-4ee0-b7b7-4dc6a22128e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:18:47 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-7d2ad3d3-e740-43b1-90fa-fe4550e43e81 tempest-TestStampPattern-1098298774 None] Created volume successfully.
Jul 03 13:18:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-af5f2729-65d0-4130-85f6-16a66865cf49 req-ad2d0a0a-f371-46e6-8b83-2f6ffa6f1f03 tempest-TestInstancesWithCinderVolumes-843868558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:18:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-af5f2729-65d0-4130-85f6-16a66865cf49 req-ad2d0a0a-f371-46e6-8b83-2f6ffa6f1f03 tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:18:54 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[7977b805-b609-4bf7-aafe-c496e9285510]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:18:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-af5f2729-65d0-4130-85f6-16a66865cf49 req-ad2d0a0a-f371-46e6-8b83-2f6ffa6f1f03 tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-773073d0-a056-4d59-8817-e339d54e678e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:18:54 devstack sudo[103537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-773073d0-a056-4d59-8817-e339d54e678e
Jul 03 13:18:54 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:18:55 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root
Jul 03 13:18:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-af5f2729-65d0-4130-85f6-16a66865cf49 req-ad2d0a0a-f371-46e6-8b83-2f6ffa6f1f03 tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-773073d0-a056-4d59-8817-e339d54e678e" returned: 0 in 0.884s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:18:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-af5f2729-65d0-4130-85f6-16a66865cf49 req-ad2d0a0a-f371-46e6-8b83-2f6ffa6f1f03 tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.906s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:18:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-af5f2729-65d0-4130-85f6-16a66865cf49 req-ad2d0a0a-f371-46e6-8b83-2f6ffa6f1f03 tempest-TestInstancesWithCinderVolumes-843868558 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db', 'name': 'volume-773073d0-a056-4d59-8817-e339d54e678e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0591d3f9-1aff-4c2b-b1b8-0c2585569121', 'enforce_multipath': True} {{(pid=86837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 13:18:55 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-af5f2729-65d0-4130-85f6-16a66865cf49 req-ad2d0a0a-f371-46e6-8b83-2f6ffa6f1f03 tempest-TestInstancesWithCinderVolumes-843868558 None] attachment_update completed successfully.
Jul 03 13:19:05 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=10,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:19:05 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=17,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:19:05 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-a851208d-1689-4a32-95d7-5ede555f4031 req-170ccf8c-1681-4fe2-95c2-ef001025fc6b tempest-TestInstancesWithCinderVolumes-843868558 None] Terminate volume connection completed successfully.
Jul 03 13:19:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-a851208d-1689-4a32-95d7-5ede555f4031 req-170ccf8c-1681-4fe2-95c2-ef001025fc6b tempest-TestInstancesWithCinderVolumes-843868558 None] Deleting attachment 28503879-7c19-454d-b9d2-05809056b7d7. {{(pid=86837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:19:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9b4ddc4c-45a6-449b-bd98-0cd3e568c09e tempest-TestInstancesWithCinderVolumes-843868558 None] Acquiring lock "cinder-b333d000-62f0-4c9e-b7cb-a40f17b4b335-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:19:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9b4ddc4c-45a6-449b-bd98-0cd3e568c09e tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "cinder-b333d000-62f0-4c9e-b7cb-a40f17b4b335-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:19:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9b4ddc4c-45a6-449b-bd98-0cd3e568c09e tempest-TestInstancesWithCinderVolumes-843868558 None] Acquiring lock "cinder-quobyte-b333d000-62f0-4c9e-b7cb-a40f17b4b335" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:19:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9b4ddc4c-45a6-449b-bd98-0cd3e568c09e tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "cinder-quobyte-b333d000-62f0-4c9e-b7cb-a40f17b4b335" acquired by "delete_volume" :: waited 0.018s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:19:07 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a8fbc4-2867-4c67-b031-76acae607fbc]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:19:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9b4ddc4c-45a6-449b-bd98-0cd3e568c09e tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b333d000-62f0-4c9e-b7cb-a40f17b4b335 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:07 devstack sudo[103670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b333d000-62f0-4c9e-b7cb-a40f17b4b335
Jul 03 13:19:07 devstack sudo[103670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:08 devstack sudo[103670]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9b4ddc4c-45a6-449b-bd98-0cd3e568c09e tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b333d000-62f0-4c9e-b7cb-a40f17b4b335" returned: 0 in 0.869s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9b4ddc4c-45a6-449b-bd98-0cd3e568c09e tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b333d000-62f0-4c9e-b7cb-a40f17b4b335 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:08 devstack sudo[103675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b333d000-62f0-4c9e-b7cb-a40f17b4b335
Jul 03 13:19:08 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:09 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9b4ddc4c-45a6-449b-bd98-0cd3e568c09e tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b333d000-62f0-4c9e-b7cb-a40f17b4b335" returned: 0 in 0.821s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9b4ddc4c-45a6-449b-bd98-0cd3e568c09e tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "cinder-quobyte-b333d000-62f0-4c9e-b7cb-a40f17b4b335" released by "delete_volume" :: held 1.747s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:19:09 devstack cinder-volume[86837]: WARNING cinder.quota [None req-9b4ddc4c-45a6-449b-bd98-0cd3e568c09e tempest-TestInstancesWithCinderVolumes-843868558 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2082683996-1120523464 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2082683996-1120523464, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:19:09 devstack cinder-volume[86837]: WARNING cinder.quota [None req-9b4ddc4c-45a6-449b-bd98-0cd3e568c09e tempest-TestInstancesWithCinderVolumes-843868558 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2082683996-1120523464 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2082683996-1120523464, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:19:09 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-9b4ddc4c-45a6-449b-bd98-0cd3e568c09e tempest-TestInstancesWithCinderVolumes-843868558 None] Created reservations ['8a1e867c-7649-4ce6-bdd6-03e437951898', 'f9c17e92-1b09-411e-8cc7-6612d34f4f09', 'dace0525-e83e-46fe-ac84-a9364843511b', '034526f7-283a-4663-9144-1cb001517993'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:19:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9b4ddc4c-45a6-449b-bd98-0cd3e568c09e tempest-TestInstancesWithCinderVolumes-843868558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:19:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9b4ddc4c-45a6-449b-bd98-0cd3e568c09e tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:19:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9b4ddc4c-45a6-449b-bd98-0cd3e568c09e tempest-TestInstancesWithCinderVolumes-843868558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:19:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9b4ddc4c-45a6-449b-bd98-0cd3e568c09e tempest-TestInstancesWithCinderVolumes-843868558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:19:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9b4ddc4c-45a6-449b-bd98-0cd3e568c09e tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:19:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9b4ddc4c-45a6-449b-bd98-0cd3e568c09e tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:09 devstack sudo[103678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:19:09 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:10 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9b4ddc4c-45a6-449b-bd98-0cd3e568c09e tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.736s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:10 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-9b4ddc4c-45a6-449b-bd98-0cd3e568c09e tempest-TestInstancesWithCinderVolumes-843868558 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:19:10 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-9b4ddc4c-45a6-449b-bd98-0cd3e568c09e tempest-TestInstancesWithCinderVolumes-843868558 None] Deleted volume successfully.
Jul 03 13:19:10 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9b4ddc4c-45a6-449b-bd98-0cd3e568c09e tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "cinder-b333d000-62f0-4c9e-b7cb-a40f17b4b335-delete_volume" released by "delete_volume" :: held 2.771s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:19:12 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-546d060b-a7a5-4fd5-8188-83a3b12ad5c3 req-1d0167fa-79b4-40f3-9a63-dff5d3a82b95 tempest-TestInstancesWithCinderVolumes-843868558 None] Terminate volume connection completed successfully.
Jul 03 13:19:12 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-546d060b-a7a5-4fd5-8188-83a3b12ad5c3 req-1d0167fa-79b4-40f3-9a63-dff5d3a82b95 tempest-TestInstancesWithCinderVolumes-843868558 None] Deleting attachment 0591d3f9-1aff-4c2b-b1b8-0c2585569121. {{(pid=86837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:19:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-940557f8-65d8-4d12-bc85-180447afac90 tempest-TestInstancesWithCinderVolumes-843868558 None] Acquiring lock "cinder-773073d0-a056-4d59-8817-e339d54e678e-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:19:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-940557f8-65d8-4d12-bc85-180447afac90 tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "cinder-773073d0-a056-4d59-8817-e339d54e678e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:19:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-940557f8-65d8-4d12-bc85-180447afac90 tempest-TestInstancesWithCinderVolumes-843868558 None] Acquiring lock "cinder-quobyte-773073d0-a056-4d59-8817-e339d54e678e" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:19:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-940557f8-65d8-4d12-bc85-180447afac90 tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "cinder-quobyte-773073d0-a056-4d59-8817-e339d54e678e" acquired by "delete_volume" :: waited 0.019s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:19:14 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e6f1d6-a730-43c0-9e36-ed5b7b68dd39]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:19:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-940557f8-65d8-4d12-bc85-180447afac90 tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-773073d0-a056-4d59-8817-e339d54e678e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:14 devstack sudo[103723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-773073d0-a056-4d59-8817-e339d54e678e
Jul 03 13:19:14 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:19:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:19:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:19:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:19:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:19:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:19:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:15 devstack sudo[103725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:19:15 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:15 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-940557f8-65d8-4d12-bc85-180447afac90 tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-773073d0-a056-4d59-8817-e339d54e678e" returned: 0 in 0.898s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-940557f8-65d8-4d12-bc85-180447afac90 tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-773073d0-a056-4d59-8817-e339d54e678e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:15 devstack sudo[103730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-773073d0-a056-4d59-8817-e339d54e678e
Jul 03 13:19:15 devstack sudo[103730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:15 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.839s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:15 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:19:15 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:19:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 28 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:19:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>, <Thread(tpool_thread_0, started daemon 134850092431040)>, <Thread(tpool_thread_1, started daemon 134850084021952)>, <Thread(tpool_thread_2, started daemon 134850075612864)>, <Thread(tpool_thread_3, started daemon 134850067203776)>, <Thread(tpool_thread_4, started daemon 134850058794688)>, <Thread(tpool_thread_5, started daemon 134850050385600)>, <Thread(tpool_thread_6, started daemon 134850041976512)>, <Thread(tpool_thread_7, started daemon 134850033567424)>, <Thread(tpool_thread_8, started daemon 134850025158336)>, <Thread(tpool_thread_9, started daemon 134850016749248)>, <Thread(tpool_thread_10, started daemon 134850008340160)>, <Thread(tpool_thread_11, started daemon 134849999931072)>, <Thread(tpool_thread_12, started daemon 134849991521984)>, <Thread(tpool_thread_13, started daemon 134849983112896)>, <Thread(tpool_thread_14, started daemon 134849974703808)>, <Thread(tpool_thread_15, started daemon 134849966294720)>, <Thread(tpool_thread_16, started daemon 134849957885632)>, <Thread(tpool_thread_17, started daemon 134849949476544)>, <Thread(tpool_thread_18, started daemon 134849941067456)>, <Thread(tpool_thread_19, started daemon 134849932658368)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:19:16 devstack sudo[103730]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-940557f8-65d8-4d12-bc85-180447afac90 tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-773073d0-a056-4d59-8817-e339d54e678e" returned: 0 in 0.876s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:16 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-940557f8-65d8-4d12-bc85-180447afac90 tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "cinder-quobyte-773073d0-a056-4d59-8817-e339d54e678e" released by "delete_volume" :: held 1.832s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:19:16 devstack cinder-volume[86837]: WARNING cinder.quota [None req-940557f8-65d8-4d12-bc85-180447afac90 tempest-TestInstancesWithCinderVolumes-843868558 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-116494806-1595407 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-116494806-1595407, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:19:16 devstack cinder-volume[86837]: WARNING cinder.quota [None req-940557f8-65d8-4d12-bc85-180447afac90 tempest-TestInstancesWithCinderVolumes-843868558 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-116494806-1595407 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-116494806-1595407, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:19:16 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-940557f8-65d8-4d12-bc85-180447afac90 tempest-TestInstancesWithCinderVolumes-843868558 None] Created reservations ['a2c84fe5-7673-4c43-8782-d7f00ee01622', 'e6811996-f808-4612-b044-cf6832f04a3a', 'b82efc89-282c-4a85-8e85-e774e3742a45', 'da4d2e10-38fa-4e22-8602-dac33e8657cf'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:19:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-940557f8-65d8-4d12-bc85-180447afac90 tempest-TestInstancesWithCinderVolumes-843868558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:19:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-940557f8-65d8-4d12-bc85-180447afac90 tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:19:16 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-940557f8-65d8-4d12-bc85-180447afac90 tempest-TestInstancesWithCinderVolumes-843868558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:19:16 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-940557f8-65d8-4d12-bc85-180447afac90 tempest-TestInstancesWithCinderVolumes-843868558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:19:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-940557f8-65d8-4d12-bc85-180447afac90 tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:19:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-940557f8-65d8-4d12-bc85-180447afac90 tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:16 devstack sudo[103735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:19:16 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:17 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-940557f8-65d8-4d12-bc85-180447afac90 tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.782s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:17 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-940557f8-65d8-4d12-bc85-180447afac90 tempest-TestInstancesWithCinderVolumes-843868558 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:19:17 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-940557f8-65d8-4d12-bc85-180447afac90 tempest-TestInstancesWithCinderVolumes-843868558 None] Deleted volume successfully.
Jul 03 13:19:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-940557f8-65d8-4d12-bc85-180447afac90 tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "cinder-773073d0-a056-4d59-8817-e339d54e678e-delete_volume" released by "delete_volume" :: held 2.882s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:19:22 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-08731b07-ed99-4260-b6b2-e3dd2f9b1df6 req-3834e162-7df9-4188-beb0-9dbadf98c207 tempest-TestInstancesWithCinderVolumes-843868558 None] Terminate volume connection completed successfully.
Jul 03 13:19:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-08731b07-ed99-4260-b6b2-e3dd2f9b1df6 req-3834e162-7df9-4188-beb0-9dbadf98c207 tempest-TestInstancesWithCinderVolumes-843868558 None] Deleting attachment e929ac03-932f-4e20-8efa-76d14114ca8e. {{(pid=86837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:19:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cc03ddf6-cb5e-4762-9172-d8ddec749dc3 tempest-TestInstancesWithCinderVolumes-843868558 None] Acquiring lock "cinder-8291c43f-bc84-49ad-a7d1-36f8db80ccf6-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:19:26 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cc03ddf6-cb5e-4762-9172-d8ddec749dc3 tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "cinder-8291c43f-bc84-49ad-a7d1-36f8db80ccf6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:19:26 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cc03ddf6-cb5e-4762-9172-d8ddec749dc3 tempest-TestInstancesWithCinderVolumes-843868558 None] Acquiring lock "cinder-quobyte-8291c43f-bc84-49ad-a7d1-36f8db80ccf6" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:19:26 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cc03ddf6-cb5e-4762-9172-d8ddec749dc3 tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "cinder-quobyte-8291c43f-bc84-49ad-a7d1-36f8db80ccf6" acquired by "delete_volume" :: waited 0.031s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:19:26 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[46276ed1-1104-40b0-8343-7fbc5dafd0b2]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:19:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cc03ddf6-cb5e-4762-9172-d8ddec749dc3 tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:26 devstack sudo[103832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6
Jul 03 13:19:26 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:27 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cc03ddf6-cb5e-4762-9172-d8ddec749dc3 tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6" returned: 0 in 0.865s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cc03ddf6-cb5e-4762-9172-d8ddec749dc3 tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-3f7e8e5e-de1b-4cbe-9905-4f2c24bdb647 req-566d3a1e-5f40-4827-9c68-a928c50d5fd9 tempest-TestStampPattern-1098298774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:19:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-3f7e8e5e-de1b-4cbe-9905-4f2c24bdb647 req-566d3a1e-5f40-4827-9c68-a928c50d5fd9 tempest-TestStampPattern-1098298774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:19:27 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[525dcf41-fc1c-4594-a4d6-9faf985a60e5]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:19:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-3f7e8e5e-de1b-4cbe-9905-4f2c24bdb647 req-566d3a1e-5f40-4827-9c68-a928c50d5fd9 tempest-TestStampPattern-1098298774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:27 devstack sudo[103844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6
Jul 03 13:19:27 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:27 devstack sudo[103845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d
Jul 03 13:19:27 devstack sudo[103845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:27 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cc03ddf6-cb5e-4762-9172-d8ddec749dc3 tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6" returned: 1 in 0.866s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cc03ddf6-cb5e-4762-9172-d8ddec749dc3 tempest-TestInstancesWithCinderVolumes-843868558 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:19:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cc03ddf6-cb5e-4762-9172-d8ddec749dc3 tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:27 devstack sudo[103854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6
Jul 03 13:19:27 devstack sudo[103854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:27 devstack sudo[103845]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-3f7e8e5e-de1b-4cbe-9905-4f2c24bdb647 req-566d3a1e-5f40-4827-9c68-a928c50d5fd9 tempest-TestStampPattern-1098298774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d" returned: 0 in 0.850s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-3f7e8e5e-de1b-4cbe-9905-4f2c24bdb647 req-566d3a1e-5f40-4827-9c68-a928c50d5fd9 tempest-TestStampPattern-1098298774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.876s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:19:28 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-3f7e8e5e-de1b-4cbe-9905-4f2c24bdb647 req-566d3a1e-5f40-4827-9c68-a928c50d5fd9 tempest-TestStampPattern-1098298774 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db', 'name': 'volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '47a246e8-da57-43f9-aa4b-c0413979173d', 'enforce_multipath': True} {{(pid=86837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 13:19:28 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-3f7e8e5e-de1b-4cbe-9905-4f2c24bdb647 req-566d3a1e-5f40-4827-9c68-a928c50d5fd9 tempest-TestStampPattern-1098298774 None] attachment_update completed successfully.
Jul 03 13:19:28 devstack sudo[103854]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cc03ddf6-cb5e-4762-9172-d8ddec749dc3 tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8291c43f-bc84-49ad-a7d1-36f8db80ccf6" returned: 0 in 0.727s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:28 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cc03ddf6-cb5e-4762-9172-d8ddec749dc3 tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "cinder-quobyte-8291c43f-bc84-49ad-a7d1-36f8db80ccf6" released by "delete_volume" :: held 2.550s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:19:28 devstack cinder-volume[86837]: WARNING cinder.quota [None req-cc03ddf6-cb5e-4762-9172-d8ddec749dc3 tempest-TestInstancesWithCinderVolumes-843868558 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-414997128-160172336 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-414997128-160172336, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:19:28 devstack cinder-volume[86837]: WARNING cinder.quota [None req-cc03ddf6-cb5e-4762-9172-d8ddec749dc3 tempest-TestInstancesWithCinderVolumes-843868558 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-414997128-160172336 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-414997128-160172336, it is now deprecated. Please use the default quota class for default quota.
Jul 03 13:19:28 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-cc03ddf6-cb5e-4762-9172-d8ddec749dc3 tempest-TestInstancesWithCinderVolumes-843868558 None] Created reservations ['c8fed072-047a-4a29-a716-5fd10ae0f8f9', 'ed076a85-06a8-419d-9aa3-591e87d04ffa', 'bce946e0-de79-4746-b8fd-a40df583cdf7', 'cac8a98e-2c03-4594-b56c-1b44e06e4938'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:19:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cc03ddf6-cb5e-4762-9172-d8ddec749dc3 tempest-TestInstancesWithCinderVolumes-843868558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:19:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cc03ddf6-cb5e-4762-9172-d8ddec749dc3 tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:19:28 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-cc03ddf6-cb5e-4762-9172-d8ddec749dc3 tempest-TestInstancesWithCinderVolumes-843868558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:19:28 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-cc03ddf6-cb5e-4762-9172-d8ddec749dc3 tempest-TestInstancesWithCinderVolumes-843868558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:19:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cc03ddf6-cb5e-4762-9172-d8ddec749dc3 tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:19:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cc03ddf6-cb5e-4762-9172-d8ddec749dc3 tempest-TestInstancesWithCinderVolumes-843868558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:28 devstack sudo[103922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:19:28 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:29 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cc03ddf6-cb5e-4762-9172-d8ddec749dc3 tempest-TestInstancesWithCinderVolumes-843868558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.780s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:29 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-cc03ddf6-cb5e-4762-9172-d8ddec749dc3 tempest-TestInstancesWithCinderVolumes-843868558 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:19:29 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-cc03ddf6-cb5e-4762-9172-d8ddec749dc3 tempest-TestInstancesWithCinderVolumes-843868558 None] Deleted volume successfully.
Jul 03 13:19:29 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cc03ddf6-cb5e-4762-9172-d8ddec749dc3 tempest-TestInstancesWithCinderVolumes-843868558 None] Lock "cinder-8291c43f-bc84-49ad-a7d1-36f8db80ccf6-delete_volume" released by "delete_volume" :: held 3.649s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:19:37 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-dccdb311-c19d-416d-a721-6a1b43141ee9 req-9cd05e82-e436-4c4f-8e69-c80095f1ef6e tempest-TestStampPattern-1098298774 None] Terminate volume connection completed successfully.
Jul 03 13:19:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-dccdb311-c19d-416d-a721-6a1b43141ee9 req-9cd05e82-e436-4c4f-8e69-c80095f1ef6e tempest-TestStampPattern-1098298774 None] Deleting attachment 47a246e8-da57-43f9-aa4b-c0413979173d. {{(pid=86837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:19:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-98507612-47e3-4d66-9d69-06399e7730c6 tempest-TestStampPattern-1098298774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:19:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-98507612-47e3-4d66-9d69-06399e7730c6 tempest-TestStampPattern-1098298774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:19:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-98507612-47e3-4d66-9d69-06399e7730c6 tempest-TestStampPattern-1098298774 None] Creating offline snapshot 9d5a3c84-f487-405e-b7e6-de96306a8834 of volume ab466321-7a88-4b8f-8b2c-26932bbe7f9d {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:19:39 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d521b3-7a1f-4fb8-84f3-2107f9fdc0f9]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:19:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-98507612-47e3-4d66-9d69-06399e7730c6 tempest-TestStampPattern-1098298774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:40 devstack sudo[104297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d
Jul 03 13:19:40 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:40 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-98507612-47e3-4d66-9d69-06399e7730c6 tempest-TestStampPattern-1098298774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d" returned: 0 in 0.874s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-98507612-47e3-4d66-9d69-06399e7730c6 tempest-TestStampPattern-1098298774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.9d5a3c84-f487-405e-b7e6-de96306a8834 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:40 devstack sudo[104302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.9d5a3c84-f487-405e-b7e6-de96306a8834 1G
Jul 03 13:19:40 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:41 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-98507612-47e3-4d66-9d69-06399e7730c6 tempest-TestStampPattern-1098298774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.9d5a3c84-f487-405e-b7e6-de96306a8834 1G" returned: 0 in 0.982s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-98507612-47e3-4d66-9d69-06399e7730c6 tempest-TestStampPattern-1098298774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.9d5a3c84-f487-405e-b7e6-de96306a8834 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:41 devstack sudo[104308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.9d5a3c84-f487-405e-b7e6-de96306a8834
Jul 03 13:19:41 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:42 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-98507612-47e3-4d66-9d69-06399e7730c6 tempest-TestStampPattern-1098298774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.9d5a3c84-f487-405e-b7e6-de96306a8834" returned: 0 in 0.741s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:42 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-98507612-47e3-4d66-9d69-06399e7730c6 tempest-TestStampPattern-1098298774 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.9d5a3c84-f487-405e-b7e6-de96306a8834 is being set with open permissions: ugo+rw
Jul 03 13:19:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-98507612-47e3-4d66-9d69-06399e7730c6 tempest-TestStampPattern-1098298774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.9d5a3c84-f487-405e-b7e6-de96306a8834 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:42 devstack sudo[104313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.9d5a3c84-f487-405e-b7e6-de96306a8834
Jul 03 13:19:42 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:43 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-98507612-47e3-4d66-9d69-06399e7730c6 tempest-TestStampPattern-1098298774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.9d5a3c84-f487-405e-b7e6-de96306a8834" returned: 0 in 0.817s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-98507612-47e3-4d66-9d69-06399e7730c6 tempest-TestStampPattern-1098298774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:43 devstack sudo[104317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.info
Jul 03 13:19:43 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:44 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-98507612-47e3-4d66-9d69-06399e7730c6 tempest-TestStampPattern-1098298774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.info" returned: 0 in 0.739s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:44 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-98507612-47e3-4d66-9d69-06399e7730c6 tempest-TestStampPattern-1098298774 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.info is being set with open permissions: ugo+rw
Jul 03 13:19:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-98507612-47e3-4d66-9d69-06399e7730c6 tempest-TestStampPattern-1098298774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:44 devstack sudo[104320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.info
Jul 03 13:19:44 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:44 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-98507612-47e3-4d66-9d69-06399e7730c6 tempest-TestStampPattern-1098298774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.info" returned: 0 in 0.720s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-98507612-47e3-4d66-9d69-06399e7730c6 tempest-TestStampPattern-1098298774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.985s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:19:44 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-98507612-47e3-4d66-9d69-06399e7730c6 tempest-TestStampPattern-1098298774 None] Create snapshot completed successfully
Jul 03 13:19:54 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=24,cinder:UPDATE=26,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:19:54 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=32,cinder:INSERT=5,cinder:UPDATE=28,cinder:DELETE=3 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Flow 'volume_create_manager' (a2053131-3e42-4ed2-b148-1bf9b097bdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d77188f-c430-4287-bd6f-388141f26132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d77188f-c430-4287-bd6f-388141f26132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1706849875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad9b105-29a0-4631-81aa-e86b146d4e09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c322ed27656b485882604cb63d9939d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9d5a3c84-f487-405e-b7e6-de96306a8834,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:19:55Z,use_quota=True,user_id='343be6d74b4d40debe02482960997ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fcff2ab-df69-47eb-8f35-90d1188ed9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fcff2ab-df69-47eb-8f35-90d1188ed9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10bd7dcc-e06c-45a2-8aec-741e9f2f1872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10bd7dcc-e06c-45a2-8aec-741e9f2f1872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4ad9b105-29a0-4631-81aa-e86b146d4e09', 'volume_name': 'volume-4ad9b105-29a0-4631-81aa-e86b146d4e09', 'volume_size': 1, 'snapshot_id': '9d5a3c84-f487-405e-b7e6-de96306a8834'}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d48f18da-2bbc-4a8c-99cc-e2f0bc6ea73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d48f18da-2bbc-4a8c-99cc-e2f0bc6ea73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af0ff14c-bfbd-49fa-b01d-12c35e318bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:19:55 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Volume 4ad9b105-29a0-4631-81aa-e86b146d4e09: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4ad9b105-29a0-4631-81aa-e86b146d4e09', 'volume_size': 1, 'snapshot_id': '9d5a3c84-f487-405e-b7e6-de96306a8834'}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Acquiring lock "cinder-quobyte-9d5a3c84-f487-405e-b7e6-de96306a8834-4ad9b105-29a0-4631-81aa-e86b146d4e09" by "_create_volume_from_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Lock "cinder-quobyte-9d5a3c84-f487-405e-b7e6-de96306a8834-4ad9b105-29a0-4631-81aa-e86b146d4e09" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Creating volume 4ad9b105-29a0-4631-81aa-e86b146d4e09 from snapshot 9d5a3c84-f487-405e-b7e6-de96306a8834 {{(pid=86837) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Acquiring lock "cinder-quobyte-4ad9b105-29a0-4631-81aa-e86b146d4e09" by "_copy_volume_from_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Lock "cinder-quobyte-4ad9b105-29a0-4631-81aa-e86b146d4e09" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] snapshot: 9d5a3c84-f487-405e-b7e6-de96306a8834, volume: 4ad9b105-29a0-4631-81aa-e86b146d4e09,  {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[47435564-2b5e-4d2d-82a1-aa68520b83d3]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:19:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.9d5a3c84-f487-405e-b7e6-de96306a8834 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:55 devstack sudo[104356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.9d5a3c84-f487-405e-b7e6-de96306a8834
Jul 03 13:19:55 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:56 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.9d5a3c84-f487-405e-b7e6-de96306a8834" returned: 0 in 0.949s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:19:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 13:19:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Creating direct copy from snapshot {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 13:19:56 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dab924-926d-453a-95ca-c884b921cb32]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:19:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:56 devstack sudo[104365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d
Jul 03 13:19:56 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:19:57 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root
Jul 03 13:19:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d" returned: 0 in 0.810s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:19:57 devstack cinder-volume[86837]: DEBUG cinder.utils [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Path /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4ad9b105-29a0-4631-81aa-e86b146d4e09 not found in is_blk_device check {{(pid=86837) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 13:19:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4ad9b105-29a0-4631-81aa-e86b146d4e09 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:19:57 devstack sudo[104370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4ad9b105-29a0-4631-81aa-e86b146d4e09
Jul 03 13:19:57 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:04 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4ad9b105-29a0-4631-81aa-e86b146d4e09" returned: 0 in 7.014s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:04 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[81865881-06cb-4459-a856-84253280490d]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:04 devstack sudo[104394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d
Jul 03 13:20:04 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:05 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:20:05 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=3 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:20:05 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d" returned: 0 in 1.541s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:05 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d, size 1024.00 MB, duration 7.02 sec, destination /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4ad9b105-29a0-4631-81aa-e86b146d4e09 {{(pid=86837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 13:20:05 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Converted 1024.00 MB image at 145.93 MB/s
Jul 03 13:20:05 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4ad9b105-29a0-4631-81aa-e86b146d4e09 is being set with open permissions: ugo+rw
Jul 03 13:20:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4ad9b105-29a0-4631-81aa-e86b146d4e09 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:05 devstack sudo[104403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4ad9b105-29a0-4631-81aa-e86b146d4e09
Jul 03 13:20:05 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:06 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4ad9b105-29a0-4631-81aa-e86b146d4e09" returned: 0 in 0.813s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:06 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Lock "cinder-quobyte-4ad9b105-29a0-4631-81aa-e86b146d4e09" released by "_copy_volume_from_snapshot" :: held 11.251s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:06 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Lock "cinder-quobyte-9d5a3c84-f487-405e-b7e6-de96306a8834-4ad9b105-29a0-4631-81aa-e86b146d4e09" released by "_create_volume_from_snapshot" :: held 11.300s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:20:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.317s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af0ff14c-bfbd-49fa-b01d-12c35e318bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ad9b105-29a0-4631-81aa-e86b146d4e09', 'volume_size': 1, 'snapshot_id': '9d5a3c84-f487-405e-b7e6-de96306a8834'}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3620ea9d-acb6-4a04-a8ca-9f0c9205e157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:06 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Volume volume-4ad9b105-29a0-4631-81aa-e86b146d4e09 (4ad9b105-29a0-4631-81aa-e86b146d4e09): created successfully
Jul 03 13:20:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3620ea9d-acb6-4a04-a8ca-9f0c9205e157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Flow 'volume_create_manager' (a2053131-3e42-4ed2-b148-1bf9b097bdb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:20:06 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-0a712532-e0f1-4a7e-9553-abd15f1c68af tempest-TestStampPattern-1098298774 None] Created volume successfully.
Jul 03 13:20:11 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:20:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Flow 'volume_create_manager' (12bb9edc-f56b-4e3f-b82e-5c95c5e32c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:20:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b2e4261-90aa-4247-8862-62deebb1e5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b2e4261-90aa-4247-8862-62deebb1e5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1741023439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b965dc5-388b-4b31-9733-256f38bd47cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca472e2d03645ba8c87ad3ea7362b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:20:12Z,use_quota=True,user_id='31a6c1d7a9154ff1838fb0c7ac409630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b65efc-72f3-4657-997a-804b8b2a2429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b65efc-72f3-4657-997a-804b8b2a2429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cad5c69-780f-4797-a567-c34abf5d8de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:11 devstack cinder-volume[86837]: DEBUG cinder.image.glance [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Creating Keystone auth plugin from conf {{(pid=86837) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 13:20:12 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cad5c69-780f-4797-a567-c34abf5d8de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5b965dc5-388b-4b31-9733-256f38bd47cc', 'volume_name': 'volume-5b965dc5-388b-4b31-9733-256f38bd47cc', 'volume_size': 1, 'image_id': '6205b5bb-0e52-4074-98de-35ab3e76638b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6205b5bb-0e52-4074-98de-35ab3e76638b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c125c5701081483fb4d62cc48d112711', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6205b5bb-0e52-4074-98de-35ab3e76638b', 'created_at': datetime.datetime(2026, 7, 3, 10, 50, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 50, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6205b5bb-0e52-4074-98de-35ab3e76638b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7aa53bfd5190>}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:12 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44fd4780-4ae5-42e8-a9a8-01a8fe3f31de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:12 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44fd4780-4ae5-42e8-a9a8-01a8fe3f31de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:12 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38330c6f-dd3c-47ee-86eb-78609b2cf1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:12 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Volume 5b965dc5-388b-4b31-9733-256f38bd47cc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5b965dc5-388b-4b31-9733-256f38bd47cc', 'volume_size': 1, 'image_id': '6205b5bb-0e52-4074-98de-35ab3e76638b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6205b5bb-0e52-4074-98de-35ab3e76638b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c125c5701081483fb4d62cc48d112711', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6205b5bb-0e52-4074-98de-35ab3e76638b', 'created_at': datetime.datetime(2026, 7, 3, 10, 50, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 50, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6205b5bb-0e52-4074-98de-35ab3e76638b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7aa53bfd5190>}
Jul 03 13:20:12 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Trying to clone 5b965dc5-388b-4b31-9733-256f38bd47cc from image 6205b5bb-0e52-4074-98de-35ab3e76638b at location (None, [{'url': 'file:///opt/stack/data/glance/images/6205b5bb-0e52-4074-98de-35ab3e76638b', 'metadata': {}}]). {{(pid=86837) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 03 13:20:12 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_ofh56hq5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86837) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 03 13:20:12 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Image download 20.69 MB at 20.69 MB/s
Jul 03 13:20:12 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6d47fb-3344-4f6f-bab9-44e002e60a4b]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_ofh56hq5devstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:12 devstack sudo[104436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_ofh56hq5devstack@QuobyteHD
Jul 03 13:20:12 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:13 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_ofh56hq5devstack@QuobyteHD" returned: 0 in 0.765s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:13 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Temporary image 6205b5bb-0e52-4074-98de-35ab3e76638b is fetched for user 31a6c1d7a9154ff1838fb0c7ac409630. {{(pid=86837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 03 13:20:13 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df6542e-1d96-4104-bf61-d3d6d3c1615e]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_ofh56hq5devstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:13 devstack sudo[104442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_ofh56hq5devstack@QuobyteHD
Jul 03 13:20:13 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:14 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_ofh56hq5devstack@QuobyteHD" returned: 0 in 0.863s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1741023439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b965dc5-388b-4b31-9733-256f38bd47cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca472e2d03645ba8c87ad3ea7362b1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:20:12Z,use_quota=True,user_id='31a6c1d7a9154ff1838fb0c7ac409630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:20:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Creating volume 5b965dc5-388b-4b31-9733-256f38bd47cc {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:20:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:20:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:20:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:20:14 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:20:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:14 devstack sudo[104482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc 1073741824
Jul 03 13:20:14 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:20:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:20:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:20:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:15 devstack sudo[104489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:20:15 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:15 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc 1073741824" returned: 0 in 1.113s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:15 devstack sudo[104495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc
Jul 03 13:20:15 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:16 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.173s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:16 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:20:16 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:20:16 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 28 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:20:16 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>, <Thread(tpool_thread_0, started daemon 134850092431040)>, <Thread(tpool_thread_1, started daemon 134850084021952)>, <Thread(tpool_thread_2, started daemon 134850075612864)>, <Thread(tpool_thread_3, started daemon 134850067203776)>, <Thread(tpool_thread_4, started daemon 134850058794688)>, <Thread(tpool_thread_5, started daemon 134850050385600)>, <Thread(tpool_thread_6, started daemon 134850041976512)>, <Thread(tpool_thread_7, started daemon 134850033567424)>, <Thread(tpool_thread_8, started daemon 134850025158336)>, <Thread(tpool_thread_9, started daemon 134850016749248)>, <Thread(tpool_thread_10, started daemon 134850008340160)>, <Thread(tpool_thread_11, started daemon 134849999931072)>, <Thread(tpool_thread_12, started daemon 134849991521984)>, <Thread(tpool_thread_13, started daemon 134849983112896)>, <Thread(tpool_thread_14, started daemon 134849974703808)>, <Thread(tpool_thread_15, started daemon 134849966294720)>, <Thread(tpool_thread_16, started daemon 134849957885632)>, <Thread(tpool_thread_17, started daemon 134849949476544)>, <Thread(tpool_thread_18, started daemon 134849941067456)>, <Thread(tpool_thread_19, started daemon 134849932658368)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:20:16 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc" returned: 0 in 1.049s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:16 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] <== create_volume: return (2276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:20:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.280s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:16 devstack cinder-volume[86837]: DEBUG cinder.volume.volume_utils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Attempting download of 6205b5bb-0e52-4074-98de-35ab3e76638b ((None, [{'url': 'file:///opt/stack/data/glance/images/6205b5bb-0e52-4074-98de-35ab3e76638b', 'metadata': {}}])) to volume 5b965dc5-388b-4b31-9733-256f38bd47cc. {{(pid=86837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 03 13:20:16 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bfc503-3bc4-41c3-94cf-94f4c9f15e39]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6205b5bb-0e52-4074-98de-35ab3e76638b__yphmm7l {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:16 devstack sudo[104500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6205b5bb-0e52-4074-98de-35ab3e76638b__yphmm7l
Jul 03 13:20:16 devstack sudo[104500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:17 devstack sudo[104500]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6205b5bb-0e52-4074-98de-35ab3e76638b__yphmm7l" returned: 0 in 0.870s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6205b5bb-0e52-4074-98de-35ab3e76638b__yphmm7l {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:17 devstack sudo[104504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6205b5bb-0e52-4074-98de-35ab3e76638b__yphmm7l
Jul 03 13:20:17 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:18 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6205b5bb-0e52-4074-98de-35ab3e76638b__yphmm7l" returned: 1 in 0.887s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6205b5bb-0e52-4074-98de-35ab3e76638b__yphmm7l' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:20:18 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d131d087-5492-4f15-9567-881c459f8b13]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_ofh56hq5devstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:18 devstack sudo[104508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_ofh56hq5devstack@QuobyteHD
Jul 03 13:20:18 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:19 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_ofh56hq5devstack@QuobyteHD" returned: 0 in 0.804s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:19 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] 6205b5bb-0e52-4074-98de-35ab3e76638b was qcow2, converting to raw {{(pid=86837) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 03 13:20:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_ofh56hq5devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:19 devstack sudo[104513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_ofh56hq5devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc
Jul 03 13:20:19 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:21 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_ofh56hq5devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc" returned: 0 in 2.295s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:21 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6205b5bb-0e52-4074-98de-35ab3e76638b_ofh56hq5devstack@QuobyteHD, size 112.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc {{(pid=86837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 13:20:21 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Converted 112.00 MB image at 48.75 MB/s
Jul 03 13:20:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:21 devstack sudo[104527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc 1G
Jul 03 13:20:21 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:22 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc 1G" returned: 0 in 0.735s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:22 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3846c54b-9eb0-4303-8948-fec960a6bc3e]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:22 devstack sudo[104532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc
Jul 03 13:20:22 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:22 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc" returned: 0 in 0.738s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:23 devstack sudo[104536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc
Jul 03 13:20:23 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:23 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc" returned: 1 in 0.833s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:20:23 devstack cinder-volume[86837]: DEBUG cinder.volume.volume_utils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Downloaded image 6205b5bb-0e52-4074-98de-35ab3e76638b ((None, [{'url': 'file:///opt/stack/data/glance/images/6205b5bb-0e52-4074-98de-35ab3e76638b', 'metadata': {}}])) to volume 5b965dc5-388b-4b31-9733-256f38bd47cc successfully. {{(pid=86837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 03 13:20:23 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Temporary image 6205b5bb-0e52-4074-98de-35ab3e76638b for user 31a6c1d7a9154ff1838fb0c7ac409630 is deleted. {{(pid=86837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 03 13:20:23 devstack cinder-volume[86837]: DEBUG cinder.volume.volume_utils [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Marking volume 5b965dc5-388b-4b31-9733-256f38bd47cc as bootable. {{(pid=86837) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 03 13:20:23 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Copying metadata from image 6205b5bb-0e52-4074-98de-35ab3e76638b to 5b965dc5-388b-4b31-9733-256f38bd47cc. {{(pid=86837) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 13:20:23 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Creating volume glance metadata for volume 5b965dc5-388b-4b31-9733-256f38bd47cc backed by image 6205b5bb-0e52-4074-98de-35ab3e76638b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6205b5bb-0e52-4074-98de-35ab3e76638b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86837) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 13:20:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38330c6f-dd3c-47ee-86eb-78609b2cf1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b965dc5-388b-4b31-9733-256f38bd47cc', 'volume_size': 1, 'image_id': '6205b5bb-0e52-4074-98de-35ab3e76638b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6205b5bb-0e52-4074-98de-35ab3e76638b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c125c5701081483fb4d62cc48d112711', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6205b5bb-0e52-4074-98de-35ab3e76638b', 'created_at': datetime.datetime(2026, 7, 3, 10, 50, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 10, 50, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6205b5bb-0e52-4074-98de-35ab3e76638b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7aa53bfd5190>}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d7d583-dfdf-4716-b8f8-f9fa0ea4364a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:20:23 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Volume volume-5b965dc5-388b-4b31-9733-256f38bd47cc (5b965dc5-388b-4b31-9733-256f38bd47cc): created successfully
Jul 03 13:20:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d7d583-dfdf-4716-b8f8-f9fa0ea4364a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:20:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Flow 'volume_create_manager' (12bb9edc-f56b-4e3f-b82e-5c95c5e32c70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:20:23 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-2315ea94-3f22-4174-9a6e-38e91c65641d tempest-TestShelveInstance-1358354005 None] Created volume successfully.
Jul 03 13:20:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-3be0584c-3ccb-4df7-aeeb-6782e2c57510 req-0fce26eb-3af4-42ff-98e0-92fafe9e5105 tempest-TestShelveInstance-1358354005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-3be0584c-3ccb-4df7-aeeb-6782e2c57510 req-0fce26eb-3af4-42ff-98e0-92fafe9e5105 tempest-TestShelveInstance-1358354005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:31 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[7748a79e-eb4b-495f-b512-101e10c963c7]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-3be0584c-3ccb-4df7-aeeb-6782e2c57510 req-0fce26eb-3af4-42ff-98e0-92fafe9e5105 tempest-TestShelveInstance-1358354005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:31 devstack sudo[104608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc
Jul 03 13:20:31 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:32 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-3be0584c-3ccb-4df7-aeeb-6782e2c57510 req-0fce26eb-3af4-42ff-98e0-92fafe9e5105 tempest-TestShelveInstance-1358354005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc" returned: 0 in 0.807s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-3be0584c-3ccb-4df7-aeeb-6782e2c57510 req-0fce26eb-3af4-42ff-98e0-92fafe9e5105 tempest-TestShelveInstance-1358354005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:32 devstack sudo[104613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc
Jul 03 13:20:32 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:33 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-3be0584c-3ccb-4df7-aeeb-6782e2c57510 req-0fce26eb-3af4-42ff-98e0-92fafe9e5105 tempest-TestShelveInstance-1358354005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc" returned: 1 in 0.823s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-3be0584c-3ccb-4df7-aeeb-6782e2c57510 req-0fce26eb-3af4-42ff-98e0-92fafe9e5105 tempest-TestShelveInstance-1358354005 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:20:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-3be0584c-3ccb-4df7-aeeb-6782e2c57510 req-0fce26eb-3af4-42ff-98e0-92fafe9e5105 tempest-TestShelveInstance-1358354005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.680s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-3be0584c-3ccb-4df7-aeeb-6782e2c57510 req-0fce26eb-3af4-42ff-98e0-92fafe9e5105 tempest-TestShelveInstance-1358354005 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db', 'name': 'volume-5b965dc5-388b-4b31-9733-256f38bd47cc', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '83739a45-bab6-4e73-8d39-a447534c1371', 'enforce_multipath': True} {{(pid=86837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 13:20:33 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-3be0584c-3ccb-4df7-aeeb-6782e2c57510 req-0fce26eb-3af4-42ff-98e0-92fafe9e5105 tempest-TestShelveInstance-1358354005 None] attachment_update completed successfully.
Jul 03 13:20:43 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:UPDATE=7,cinder:SELECT=15,cinder:INSERT=8 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:20:43 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=16,cinder:DELETE=2,cinder:UPDATE=8,cinder:INSERT=6 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:20:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-55ab2653-d8a5-495c-a25f-3c07ddc161ff req-890fe243-2158-42bb-b915-b83662db3aa5 tempest-TestStampPattern-1098298774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:20:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-55ab2653-d8a5-495c-a25f-3c07ddc161ff req-890fe243-2158-42bb-b915-b83662db3aa5 tempest-TestStampPattern-1098298774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:20:48 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f67094-9d79-4cf3-8c04-58f51680540a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:20:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-55ab2653-d8a5-495c-a25f-3c07ddc161ff req-890fe243-2158-42bb-b915-b83662db3aa5 tempest-TestStampPattern-1098298774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4ad9b105-29a0-4631-81aa-e86b146d4e09 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:20:48 devstack sudo[105084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4ad9b105-29a0-4631-81aa-e86b146d4e09
Jul 03 13:20:48 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:20:49 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root
Jul 03 13:20:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-55ab2653-d8a5-495c-a25f-3c07ddc161ff req-890fe243-2158-42bb-b915-b83662db3aa5 tempest-TestStampPattern-1098298774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4ad9b105-29a0-4631-81aa-e86b146d4e09" returned: 0 in 0.815s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:20:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-55ab2653-d8a5-495c-a25f-3c07ddc161ff req-890fe243-2158-42bb-b915-b83662db3aa5 tempest-TestStampPattern-1098298774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.839s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:20:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-55ab2653-d8a5-495c-a25f-3c07ddc161ff req-890fe243-2158-42bb-b915-b83662db3aa5 tempest-TestStampPattern-1098298774 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db', 'name': 'volume-4ad9b105-29a0-4631-81aa-e86b146d4e09', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '445af3c8-2eb8-4ed7-9bcf-8ff6aef1717e', 'enforce_multipath': True} {{(pid=86837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 13:20:49 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-55ab2653-d8a5-495c-a25f-3c07ddc161ff req-890fe243-2158-42bb-b915-b83662db3aa5 tempest-TestStampPattern-1098298774 None] attachment_update completed successfully.
Jul 03 13:20:56 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-56a56f45-a6f4-457f-b6b2-fb10c57ffbf0 req-003ffebe-15d6-4fb1-aefc-9697ad07589e tempest-TestStampPattern-1098298774 None] Terminate volume connection completed successfully.
Jul 03 13:20:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-56a56f45-a6f4-457f-b6b2-fb10c57ffbf0 req-003ffebe-15d6-4fb1-aefc-9697ad07589e tempest-TestStampPattern-1098298774 None] Deleting attachment 445af3c8-2eb8-4ed7-9bcf-8ff6aef1717e. {{(pid=86837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:21:06 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:21:06 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:21:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-36e57761-6cbb-40f2-a66d-0c9eafd512cf tempest-TestStampPattern-1098298774 None] Acquiring lock "cinder-4ad9b105-29a0-4631-81aa-e86b146d4e09-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-36e57761-6cbb-40f2-a66d-0c9eafd512cf tempest-TestStampPattern-1098298774 None] Lock "cinder-4ad9b105-29a0-4631-81aa-e86b146d4e09-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-36e57761-6cbb-40f2-a66d-0c9eafd512cf tempest-TestStampPattern-1098298774 None] Acquiring lock "cinder-quobyte-4ad9b105-29a0-4631-81aa-e86b146d4e09" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-36e57761-6cbb-40f2-a66d-0c9eafd512cf tempest-TestStampPattern-1098298774 None] Lock "cinder-quobyte-4ad9b105-29a0-4631-81aa-e86b146d4e09" acquired by "delete_volume" :: waited 0.017s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:08 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d7a153-3364-481a-9ec2-26aaca34996f]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:21:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-36e57761-6cbb-40f2-a66d-0c9eafd512cf tempest-TestStampPattern-1098298774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4ad9b105-29a0-4631-81aa-e86b146d4e09 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:08 devstack sudo[105275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4ad9b105-29a0-4631-81aa-e86b146d4e09
Jul 03 13:21:08 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:09 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-36e57761-6cbb-40f2-a66d-0c9eafd512cf tempest-TestStampPattern-1098298774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4ad9b105-29a0-4631-81aa-e86b146d4e09" returned: 0 in 0.907s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-36e57761-6cbb-40f2-a66d-0c9eafd512cf tempest-TestStampPattern-1098298774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4ad9b105-29a0-4631-81aa-e86b146d4e09 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:09 devstack sudo[105319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4ad9b105-29a0-4631-81aa-e86b146d4e09
Jul 03 13:21:09 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:09 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-36e57761-6cbb-40f2-a66d-0c9eafd512cf tempest-TestStampPattern-1098298774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4ad9b105-29a0-4631-81aa-e86b146d4e09" returned: 0 in 0.689s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-36e57761-6cbb-40f2-a66d-0c9eafd512cf tempest-TestStampPattern-1098298774 None] Lock "cinder-quobyte-4ad9b105-29a0-4631-81aa-e86b146d4e09" released by "delete_volume" :: held 1.640s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:09 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-36e57761-6cbb-40f2-a66d-0c9eafd512cf tempest-TestStampPattern-1098298774 None] Created reservations ['6e543eba-c4d3-4914-bad6-88a34773a79b', '15243044-d2af-48ca-9d0b-bcc2a115358a', 'b3fa6475-32bd-4f08-8d84-28cd180b846f', '007857a9-7e81-4696-a9f6-0793e9776550'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:21:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-36e57761-6cbb-40f2-a66d-0c9eafd512cf tempest-TestStampPattern-1098298774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-36e57761-6cbb-40f2-a66d-0c9eafd512cf tempest-TestStampPattern-1098298774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-36e57761-6cbb-40f2-a66d-0c9eafd512cf tempest-TestStampPattern-1098298774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:21:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-36e57761-6cbb-40f2-a66d-0c9eafd512cf tempest-TestStampPattern-1098298774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:21:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-36e57761-6cbb-40f2-a66d-0c9eafd512cf tempest-TestStampPattern-1098298774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-36e57761-6cbb-40f2-a66d-0c9eafd512cf tempest-TestStampPattern-1098298774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:09 devstack sudo[105323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:21:09 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:10 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-36e57761-6cbb-40f2-a66d-0c9eafd512cf tempest-TestStampPattern-1098298774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.682s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:10 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-36e57761-6cbb-40f2-a66d-0c9eafd512cf tempest-TestStampPattern-1098298774 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:21:10 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-36e57761-6cbb-40f2-a66d-0c9eafd512cf tempest-TestStampPattern-1098298774 None] Deleted volume successfully.
Jul 03 13:21:10 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7d1452d9-b702-4ecc-959f-5a139ca8a9f5 tempest-TestStampPattern-1098298774 None] Acquiring lock "cinder-9d5a3c84-f487-405e-b7e6-de96306a8834-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:10 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-36e57761-6cbb-40f2-a66d-0c9eafd512cf tempest-TestStampPattern-1098298774 None] Lock "cinder-4ad9b105-29a0-4631-81aa-e86b146d4e09-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:10 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7d1452d9-b702-4ecc-959f-5a139ca8a9f5 tempest-TestStampPattern-1098298774 None] Lock "cinder-9d5a3c84-f487-405e-b7e6-de96306a8834-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:10 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7d1452d9-b702-4ecc-959f-5a139ca8a9f5 tempest-TestStampPattern-1098298774 None] Acquiring lock "cinder-quobyte-ab466321-7a88-4b8f-8b2c-26932bbe7f9d" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:10 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7d1452d9-b702-4ecc-959f-5a139ca8a9f5 tempest-TestStampPattern-1098298774 None] Lock "cinder-quobyte-ab466321-7a88-4b8f-8b2c-26932bbe7f9d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:10 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7d1452d9-b702-4ecc-959f-5a139ca8a9f5 tempest-TestStampPattern-1098298774 None] Acquiring lock "cinder-quobyte-9d5a3c84-f487-405e-b7e6-de96306a8834" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:10 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7d1452d9-b702-4ecc-959f-5a139ca8a9f5 tempest-TestStampPattern-1098298774 None] Lock "cinder-quobyte-9d5a3c84-f487-405e-b7e6-de96306a8834" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:10 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-7d1452d9-b702-4ecc-959f-5a139ca8a9f5 tempest-TestStampPattern-1098298774 None] Deleting offline snapshot 9d5a3c84-f487-405e-b7e6-de96306a8834 of volume ab466321-7a88-4b8f-8b2c-26932bbe7f9d {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:21:10 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-7d1452d9-b702-4ecc-959f-5a139ca8a9f5 tempest-TestStampPattern-1098298774 None] snapshot_file for this snap is: volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.9d5a3c84-f487-405e-b7e6-de96306a8834 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:21:10 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a07072c-e864-4343-8389-214336e6ca9b]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:21:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7d1452d9-b702-4ecc-959f-5a139ca8a9f5 tempest-TestStampPattern-1098298774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.9d5a3c84-f487-405e-b7e6-de96306a8834 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:10 devstack sudo[105326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.9d5a3c84-f487-405e-b7e6-de96306a8834
Jul 03 13:21:10 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:11 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7d1452d9-b702-4ecc-959f-5a139ca8a9f5 tempest-TestStampPattern-1098298774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.9d5a3c84-f487-405e-b7e6-de96306a8834" returned: 0 in 0.910s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-7d1452d9-b702-4ecc-959f-5a139ca8a9f5 tempest-TestStampPattern-1098298774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:21:11 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f4bdc5-8639-4728-b101-85c45859c84a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:21:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7d1452d9-b702-4ecc-959f-5a139ca8a9f5 tempest-TestStampPattern-1098298774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:11 devstack sudo[105333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d
Jul 03 13:21:11 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:12 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7d1452d9-b702-4ecc-959f-5a139ca8a9f5 tempest-TestStampPattern-1098298774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d" returned: 0 in 0.882s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7d1452d9-b702-4ecc-959f-5a139ca8a9f5 tempest-TestStampPattern-1098298774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.9d5a3c84-f487-405e-b7e6-de96306a8834 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:12 devstack sudo[105340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.9d5a3c84-f487-405e-b7e6-de96306a8834
Jul 03 13:21:12 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:12 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-e47d7d67-c29e-4c65-a5e6-bd6a8e2c1cec req-eddcddaf-0b02-4f41-9d56-a6c35680994e tempest-TestShelveInstance-1358354005 None] Terminate volume connection completed successfully.
Jul 03 13:21:12 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-e47d7d67-c29e-4c65-a5e6-bd6a8e2c1cec req-eddcddaf-0b02-4f41-9d56-a6c35680994e tempest-TestShelveInstance-1358354005 None] Deleting attachment 83739a45-bab6-4e73-8d39-a447534c1371. {{(pid=86837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:21:13 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7d1452d9-b702-4ecc-959f-5a139ca8a9f5 tempest-TestStampPattern-1098298774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.9d5a3c84-f487-405e-b7e6-de96306a8834" returned: 0 in 0.790s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7d1452d9-b702-4ecc-959f-5a139ca8a9f5 tempest-TestStampPattern-1098298774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.9d5a3c84-f487-405e-b7e6-de96306a8834 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:13 devstack sudo[105346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.9d5a3c84-f487-405e-b7e6-de96306a8834
Jul 03 13:21:13 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:14 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7d1452d9-b702-4ecc-959f-5a139ca8a9f5 tempest-TestStampPattern-1098298774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d.9d5a3c84-f487-405e-b7e6-de96306a8834" returned: 0 in 0.732s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7d1452d9-b702-4ecc-959f-5a139ca8a9f5 tempest-TestStampPattern-1098298774 None] Lock "cinder-quobyte-9d5a3c84-f487-405e-b7e6-de96306a8834" released by "_delete_snapshot" :: held 3.419s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7d1452d9-b702-4ecc-959f-5a139ca8a9f5 tempest-TestStampPattern-1098298774 None] Lock "cinder-quobyte-ab466321-7a88-4b8f-8b2c-26932bbe7f9d" released by "delete_snapshot" :: held 3.441s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:14 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-7d1452d9-b702-4ecc-959f-5a139ca8a9f5 tempest-TestStampPattern-1098298774 None] Created reservations ['837d9002-861e-443e-8526-60538f85470f', '0d1711f7-7a38-4a9a-ad13-e1274535bcbb', '25a0710c-0a2e-4da1-99b9-f1bec9a8a9c6', 'cea267c3-4230-43c6-b342-87a24459365c'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:21:14 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-7d1452d9-b702-4ecc-959f-5a139ca8a9f5 tempest-TestStampPattern-1098298774 None] Delete snapshot completed successfully.
Jul 03 13:21:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7d1452d9-b702-4ecc-959f-5a139ca8a9f5 tempest-TestStampPattern-1098298774 None] Lock "cinder-9d5a3c84-f487-405e-b7e6-de96306a8834-delete_snapshot" released by "delete_snapshot" :: held 3.595s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:21:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:21:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:21:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:15 devstack sudo[105350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:21:15 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:15 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.907s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:15 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:21:15 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:21:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 28 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:21:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>, <Thread(tpool_thread_0, started daemon 134850092431040)>, <Thread(tpool_thread_1, started daemon 134850084021952)>, <Thread(tpool_thread_2, started daemon 134850075612864)>, <Thread(tpool_thread_3, started daemon 134850067203776)>, <Thread(tpool_thread_4, started daemon 134850058794688)>, <Thread(tpool_thread_5, started daemon 134850050385600)>, <Thread(tpool_thread_6, started daemon 134850041976512)>, <Thread(tpool_thread_7, started daemon 134850033567424)>, <Thread(tpool_thread_8, started daemon 134850025158336)>, <Thread(tpool_thread_9, started daemon 134850016749248)>, <Thread(tpool_thread_10, started daemon 134850008340160)>, <Thread(tpool_thread_11, started daemon 134849999931072)>, <Thread(tpool_thread_12, started daemon 134849991521984)>, <Thread(tpool_thread_13, started daemon 134849983112896)>, <Thread(tpool_thread_14, started daemon 134849974703808)>, <Thread(tpool_thread_15, started daemon 134849966294720)>, <Thread(tpool_thread_16, started daemon 134849957885632)>, <Thread(tpool_thread_17, started daemon 134849949476544)>, <Thread(tpool_thread_18, started daemon 134849941067456)>, <Thread(tpool_thread_19, started daemon 134849932658368)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:21:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-79c96342-39f5-4068-b2c2-4dc1a8f1add3 req-10fa6f26-e35e-4c92-b2b3-3f28d6c78908 tempest-TestShelveInstance-1358354005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-79c96342-39f5-4068-b2c2-4dc1a8f1add3 req-10fa6f26-e35e-4c92-b2b3-3f28d6c78908 tempest-TestShelveInstance-1358354005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:18 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ca94b8-bbc2-4b4a-ae99-bacc17a1bac0]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:21:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-79c96342-39f5-4068-b2c2-4dc1a8f1add3 req-10fa6f26-e35e-4c92-b2b3-3f28d6c78908 tempest-TestShelveInstance-1358354005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:18 devstack sudo[105406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc
Jul 03 13:21:18 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:19 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-79c96342-39f5-4068-b2c2-4dc1a8f1add3 req-10fa6f26-e35e-4c92-b2b3-3f28d6c78908 tempest-TestShelveInstance-1358354005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc" returned: 0 in 0.856s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-79c96342-39f5-4068-b2c2-4dc1a8f1add3 req-10fa6f26-e35e-4c92-b2b3-3f28d6c78908 tempest-TestShelveInstance-1358354005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:19 devstack sudo[105411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc
Jul 03 13:21:19 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:20 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-79c96342-39f5-4068-b2c2-4dc1a8f1add3 req-10fa6f26-e35e-4c92-b2b3-3f28d6c78908 tempest-TestShelveInstance-1358354005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc" returned: 1 in 0.811s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-79c96342-39f5-4068-b2c2-4dc1a8f1add3 req-10fa6f26-e35e-4c92-b2b3-3f28d6c78908 tempest-TestShelveInstance-1358354005 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:21:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-79c96342-39f5-4068-b2c2-4dc1a8f1add3 req-10fa6f26-e35e-4c92-b2b3-3f28d6c78908 tempest-TestShelveInstance-1358354005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.714s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-79c96342-39f5-4068-b2c2-4dc1a8f1add3 req-10fa6f26-e35e-4c92-b2b3-3f28d6c78908 tempest-TestShelveInstance-1358354005 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db', 'name': 'volume-5b965dc5-388b-4b31-9733-256f38bd47cc', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2eb9bd1-7fc7-4fd7-8be8-7005c4d4d967', 'enforce_multipath': True} {{(pid=86837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 13:21:20 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-79c96342-39f5-4068-b2c2-4dc1a8f1add3 req-10fa6f26-e35e-4c92-b2b3-3f28d6c78908 tempest-TestShelveInstance-1358354005 None] attachment_update completed successfully.
Jul 03 13:21:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c0c650bb-67e1-4821-acd8-18c17532ba4e tempest-TestStampPattern-1098298774 None] Acquiring lock "cinder-ab466321-7a88-4b8f-8b2c-26932bbe7f9d-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c0c650bb-67e1-4821-acd8-18c17532ba4e tempest-TestStampPattern-1098298774 None] Lock "cinder-ab466321-7a88-4b8f-8b2c-26932bbe7f9d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c0c650bb-67e1-4821-acd8-18c17532ba4e tempest-TestStampPattern-1098298774 None] Acquiring lock "cinder-quobyte-ab466321-7a88-4b8f-8b2c-26932bbe7f9d" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c0c650bb-67e1-4821-acd8-18c17532ba4e tempest-TestStampPattern-1098298774 None] Lock "cinder-quobyte-ab466321-7a88-4b8f-8b2c-26932bbe7f9d" acquired by "delete_volume" :: waited 0.015s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:23 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[29eb8a19-97b7-45f2-9881-da29062232c8]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:21:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c0c650bb-67e1-4821-acd8-18c17532ba4e tempest-TestStampPattern-1098298774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:23 devstack sudo[105423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d
Jul 03 13:21:23 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:24 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c0c650bb-67e1-4821-acd8-18c17532ba4e tempest-TestStampPattern-1098298774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d" returned: 0 in 0.844s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c0c650bb-67e1-4821-acd8-18c17532ba4e tempest-TestStampPattern-1098298774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:24 devstack sudo[105465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d
Jul 03 13:21:24 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:25 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c0c650bb-67e1-4821-acd8-18c17532ba4e tempest-TestStampPattern-1098298774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ab466321-7a88-4b8f-8b2c-26932bbe7f9d" returned: 0 in 0.676s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c0c650bb-67e1-4821-acd8-18c17532ba4e tempest-TestStampPattern-1098298774 None] Lock "cinder-quobyte-ab466321-7a88-4b8f-8b2c-26932bbe7f9d" released by "delete_volume" :: held 1.585s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:25 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-c0c650bb-67e1-4821-acd8-18c17532ba4e tempest-TestStampPattern-1098298774 None] Created reservations ['b542a1b5-60f6-4d0a-8748-c312af4160d5', '2945d5c4-fc4c-43c8-a7a1-2bc8529f374c', '78d0c550-8b5a-49c9-ae69-f04b8fd4ce14', '4182ade5-8fba-455b-bf73-4a734d753bce'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:21:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c0c650bb-67e1-4821-acd8-18c17532ba4e tempest-TestStampPattern-1098298774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c0c650bb-67e1-4821-acd8-18c17532ba4e tempest-TestStampPattern-1098298774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c0c650bb-67e1-4821-acd8-18c17532ba4e tempest-TestStampPattern-1098298774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:21:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c0c650bb-67e1-4821-acd8-18c17532ba4e tempest-TestStampPattern-1098298774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:21:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c0c650bb-67e1-4821-acd8-18c17532ba4e tempest-TestStampPattern-1098298774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c0c650bb-67e1-4821-acd8-18c17532ba4e tempest-TestStampPattern-1098298774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:25 devstack sudo[105468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:21:25 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:25 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c0c650bb-67e1-4821-acd8-18c17532ba4e tempest-TestStampPattern-1098298774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.752s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:25 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-c0c650bb-67e1-4821-acd8-18c17532ba4e tempest-TestStampPattern-1098298774 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:21:25 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-c0c650bb-67e1-4821-acd8-18c17532ba4e tempest-TestStampPattern-1098298774 None] Deleted volume successfully.
Jul 03 13:21:26 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c0c650bb-67e1-4821-acd8-18c17532ba4e tempest-TestStampPattern-1098298774 None] Lock "cinder-ab466321-7a88-4b8f-8b2c-26932bbe7f9d-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:35 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=23,cinder:INSERT=6,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:21:35 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:UPDATE=22,cinder:SELECT=21,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Flow 'volume_create_manager' (dc27954c-c278-4964-a0d1-f47f56084beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (418af3b3-bbd5-4ebd-93c4-3c891e6182d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (418af3b3-bbd5-4ebd-93c4-3c891e6182d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-783820317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6cb4e02-7ac9-49ac-9a8e-62edbaaa037b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e62da041c7fb47c4ab03d90babeb1d97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:21:38Z,use_quota=True,user_id='339e9058d8c04a57b961c6a86f29559d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afac4551-4b2a-444e-ac8e-4d95edf8e57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afac4551-4b2a-444e-ac8e-4d95edf8e57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b54bc4b-3455-48e0-ab6d-289523b9ec8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b54bc4b-3455-48e0-ab6d-289523b9ec8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6cb4e02-7ac9-49ac-9a8e-62edbaaa037b', 'volume_name': 'volume-c6cb4e02-7ac9-49ac-9a8e-62edbaaa037b', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a35cff23-713d-4614-8f31-dc3f7ec49a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a35cff23-713d-4614-8f31-dc3f7ec49a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68e0da6c-da5e-486a-91e9-861de5de72a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:38 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Volume c6cb4e02-7ac9-49ac-9a8e-62edbaaa037b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6cb4e02-7ac9-49ac-9a8e-62edbaaa037b', 'volume_size': 1}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-783820317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6cb4e02-7ac9-49ac-9a8e-62edbaaa037b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e62da041c7fb47c4ab03d90babeb1d97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:21:38Z,use_quota=True,user_id='339e9058d8c04a57b961c6a86f29559d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Creating volume c6cb4e02-7ac9-49ac-9a8e-62edbaaa037b {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:21:38 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c6cb4e02-7ac9-49ac-9a8e-62edbaaa037b 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:38 devstack sudo[105925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c6cb4e02-7ac9-49ac-9a8e-62edbaaa037b 1073741824
Jul 03 13:21:38 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Flow 'volume_create_manager' (c457f040-4b98-4ce7-ad03-39bd4626a3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bdfb5b8-47f9-4ac6-a7bc-78e3e0be6ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bdfb5b8-47f9-4ac6-a7bc-78e3e0be6ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-198187103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c512cd4a-eae7-4eee-8151-d3eef4c3795d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e62da041c7fb47c4ab03d90babeb1d97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:21:38Z,use_quota=True,user_id='339e9058d8c04a57b961c6a86f29559d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a22374c-c8cf-4e73-b7be-c8d498d9290b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a22374c-c8cf-4e73-b7be-c8d498d9290b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7140e5ea-bcd8-4262-b3ec-f1e43db175a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7140e5ea-bcd8-4262-b3ec-f1e43db175a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c512cd4a-eae7-4eee-8151-d3eef4c3795d', 'volume_name': 'volume-c512cd4a-eae7-4eee-8151-d3eef4c3795d', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4e0db5-45df-4ef2-8799-f10191410460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4e0db5-45df-4ef2-8799-f10191410460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f89020-3c75-4806-8dc6-567f7c4b6ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:38 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Volume c512cd4a-eae7-4eee-8151-d3eef4c3795d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c512cd4a-eae7-4eee-8151-d3eef4c3795d', 'volume_size': 1}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Flow 'volume_create_manager' (faf2e149-80b3-45ab-b9c3-8d925957f053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34899570-5460-4d9a-bb1a-d023061b4b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34899570-5460-4d9a-bb1a-d023061b4b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1641031611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22112da6-2901-43e8-a5b7-0c15c0287d7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e62da041c7fb47c4ab03d90babeb1d97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:21:39Z,use_quota=True,user_id='339e9058d8c04a57b961c6a86f29559d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d0d03d8-392b-4e8d-b71f-71af8c726790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d0d03d8-392b-4e8d-b71f-71af8c726790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (387d2a0a-adc1-4b6a-a516-f96680c9e442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (387d2a0a-adc1-4b6a-a516-f96680c9e442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22112da6-2901-43e8-a5b7-0c15c0287d7b', 'volume_name': 'volume-22112da6-2901-43e8-a5b7-0c15c0287d7b', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1325024b-30b4-4adf-9a84-582e9464e547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1325024b-30b4-4adf-9a84-582e9464e547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2770769d-5f2b-4735-97ed-e9900402c22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:39 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Volume 22112da6-2901-43e8-a5b7-0c15c0287d7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22112da6-2901-43e8-a5b7-0c15c0287d7b', 'volume_size': 1}
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:39 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c6cb4e02-7ac9-49ac-9a8e-62edbaaa037b 1073741824" returned: 0 in 1.132s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Flow 'volume_create_manager' (58bc4aaf-6df7-4ef2-9399-8dfa8434f673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7020a6b6-6918-4877-8dd0-1dc1cd2d479d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c6cb4e02-7ac9-49ac-9a8e-62edbaaa037b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7020a6b6-6918-4877-8dd0-1dc1cd2d479d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-4610680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=328d0ad5-f72b-447a-a9a3-f678b75fe095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e62da041c7fb47c4ab03d90babeb1d97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:21:39Z,use_quota=True,user_id='339e9058d8c04a57b961c6a86f29559d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:39 devstack sudo[105932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c6cb4e02-7ac9-49ac-9a8e-62edbaaa037b
Jul 03 13:21:39 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ab8dbe-c8cd-49f9-828a-2bbf9a7f6759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ab8dbe-c8cd-49f9-828a-2bbf9a7f6759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5ef5209-1371-4230-93fc-943d7d7ace34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5ef5209-1371-4230-93fc-943d7d7ace34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '328d0ad5-f72b-447a-a9a3-f678b75fe095', 'volume_name': 'volume-328d0ad5-f72b-447a-a9a3-f678b75fe095', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9b534d-81f5-4cf0-a517-414f29afc607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9b534d-81f5-4cf0-a517-414f29afc607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc69c804-422f-4aae-90a5-2ed1e36fdfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:39 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Volume 328d0ad5-f72b-447a-a9a3-f678b75fe095: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-328d0ad5-f72b-447a-a9a3-f678b75fe095', 'volume_size': 1}
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Flow 'volume_create_manager' (f116cfbc-ab90-4c63-9fc6-bf8405e1a751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061e68fe-43cb-4e42-8f40-087426951cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061e68fe-43cb-4e42-8f40-087426951cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-436765294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e748c9-8ee4-40e3-9d32-708b73b2261a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e62da041c7fb47c4ab03d90babeb1d97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:21:40Z,use_quota=True,user_id='339e9058d8c04a57b961c6a86f29559d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e274f9-e729-43e0-add6-46407d994585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e274f9-e729-43e0-add6-46407d994585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (413ac8c5-c622-48d0-9fe6-6cf31ce2b15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (413ac8c5-c622-48d0-9fe6-6cf31ce2b15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57e748c9-8ee4-40e3-9d32-708b73b2261a', 'volume_name': 'volume-57e748c9-8ee4-40e3-9d32-708b73b2261a', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09a9ff80-1a97-45d4-ad77-5eeb23aacb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09a9ff80-1a97-45d4-ad77-5eeb23aacb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ed3156-7c9f-437a-9cae-17b83bc64917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:39 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Volume 57e748c9-8ee4-40e3-9d32-708b73b2261a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57e748c9-8ee4-40e3-9d32-708b73b2261a', 'volume_size': 1}
Jul 03 13:21:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:40 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c6cb4e02-7ac9-49ac-9a8e-62edbaaa037b" returned: 0 in 0.771s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:40 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:21:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.497s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:40 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-198187103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c512cd4a-eae7-4eee-8151-d3eef4c3795d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e62da041c7fb47c4ab03d90babeb1d97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:21:38Z,use_quota=True,user_id='339e9058d8c04a57b961c6a86f29559d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:21:40 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Creating volume c512cd4a-eae7-4eee-8151-d3eef4c3795d {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:21:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:40 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:21:40 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:21:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:40 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:21:40 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:21:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c512cd4a-eae7-4eee-8151-d3eef4c3795d 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:40 devstack sudo[105935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c512cd4a-eae7-4eee-8151-d3eef4c3795d 1073741824
Jul 03 13:21:40 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68e0da6c-da5e-486a-91e9-861de5de72a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6cb4e02-7ac9-49ac-9a8e-62edbaaa037b', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:40 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:40 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0c2167-beac-47b8-b2cf-b3a1f5bab5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:40 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Volume volume-c6cb4e02-7ac9-49ac-9a8e-62edbaaa037b (c6cb4e02-7ac9-49ac-9a8e-62edbaaa037b): created successfully
Jul 03 13:21:40 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0c2167-beac-47b8-b2cf-b3a1f5bab5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:40 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Flow 'volume_create_manager' (dc27954c-c278-4964-a0d1-f47f56084beb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:21:40 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-44c6fbac-819e-45d5-a5f8-2bd4e78e81d1 tempest-CreateVolumesFromImageTest-323147659 None] Created volume successfully.
Jul 03 13:21:41 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c512cd4a-eae7-4eee-8151-d3eef4c3795d 1073741824" returned: 0 in 0.847s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c512cd4a-eae7-4eee-8151-d3eef4c3795d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:41 devstack sudo[105940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c512cd4a-eae7-4eee-8151-d3eef4c3795d
Jul 03 13:21:41 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:41 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c512cd4a-eae7-4eee-8151-d3eef4c3795d" returned: 0 in 0.641s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:21:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.694s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1641031611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22112da6-2901-43e8-a5b7-0c15c0287d7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e62da041c7fb47c4ab03d90babeb1d97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:21:39Z,use_quota=True,user_id='339e9058d8c04a57b961c6a86f29559d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:21:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Creating volume 22112da6-2901-43e8-a5b7-0c15c0287d7b {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:21:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:21:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:21:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:21:41 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:21:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-22112da6-2901-43e8-a5b7-0c15c0287d7b 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:41 devstack sudo[105943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-22112da6-2901-43e8-a5b7-0c15c0287d7b 1073741824
Jul 03 13:21:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f89020-3c75-4806-8dc6-567f7c4b6ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c512cd4a-eae7-4eee-8151-d3eef4c3795d', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:41 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2219ba91-87c8-4878-8722-8e242fd2fcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:41 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Volume volume-c512cd4a-eae7-4eee-8151-d3eef4c3795d (c512cd4a-eae7-4eee-8151-d3eef4c3795d): created successfully
Jul 03 13:21:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2219ba91-87c8-4878-8722-8e242fd2fcc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Flow 'volume_create_manager' (c457f040-4b98-4ce7-ad03-39bd4626a3a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:21:41 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-e57927d3-2373-437a-a490-b81c7b66e156 tempest-CreateVolumesFromImageTest-323147659 None] Created volume successfully.
Jul 03 13:21:42 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-22112da6-2901-43e8-a5b7-0c15c0287d7b 1073741824" returned: 0 in 0.868s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-22112da6-2901-43e8-a5b7-0c15c0287d7b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:42 devstack sudo[105948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-22112da6-2901-43e8-a5b7-0c15c0287d7b
Jul 03 13:21:42 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:43 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-22112da6-2901-43e8-a5b7-0c15c0287d7b" returned: 0 in 0.665s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:43 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:21:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.842s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:43 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-4610680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=328d0ad5-f72b-447a-a9a3-f678b75fe095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e62da041c7fb47c4ab03d90babeb1d97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:21:39Z,use_quota=True,user_id='339e9058d8c04a57b961c6a86f29559d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:21:43 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Creating volume 328d0ad5-f72b-447a-a9a3-f678b75fe095 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:21:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:43 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:21:43 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:21:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:43 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:21:43 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:21:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-328d0ad5-f72b-447a-a9a3-f678b75fe095 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2770769d-5f2b-4735-97ed-e9900402c22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22112da6-2901-43e8-a5b7-0c15c0287d7b', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a3eb038-50fa-4397-8961-4ae597cb0359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:43 devstack sudo[105952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-328d0ad5-f72b-447a-a9a3-f678b75fe095 1073741824
Jul 03 13:21:43 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:43 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Volume volume-22112da6-2901-43e8-a5b7-0c15c0287d7b (22112da6-2901-43e8-a5b7-0c15c0287d7b): created successfully
Jul 03 13:21:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a3eb038-50fa-4397-8961-4ae597cb0359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Flow 'volume_create_manager' (faf2e149-80b3-45ab-b9c3-8d925957f053) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:21:43 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-14941c88-ddee-4a1d-905e-c53f9ce886d7 tempest-CreateVolumesFromImageTest-323147659 None] Created volume successfully.
Jul 03 13:21:44 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-328d0ad5-f72b-447a-a9a3-f678b75fe095 1073741824" returned: 0 in 0.876s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-328d0ad5-f72b-447a-a9a3-f678b75fe095 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:44 devstack sudo[105958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-328d0ad5-f72b-447a-a9a3-f678b75fe095
Jul 03 13:21:44 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:44 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-328d0ad5-f72b-447a-a9a3-f678b75fe095" returned: 0 in 0.642s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:21:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.092s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-436765294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e748c9-8ee4-40e3-9d32-708b73b2261a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e62da041c7fb47c4ab03d90babeb1d97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:21:40Z,use_quota=True,user_id='339e9058d8c04a57b961c6a86f29559d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:21:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Creating volume 57e748c9-8ee4-40e3-9d32-708b73b2261a {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:21:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:21:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:21:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:21:44 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:21:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-57e748c9-8ee4-40e3-9d32-708b73b2261a 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:44 devstack sudo[105961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-57e748c9-8ee4-40e3-9d32-708b73b2261a 1073741824
Jul 03 13:21:44 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc69c804-422f-4aae-90a5-2ed1e36fdfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-328d0ad5-f72b-447a-a9a3-f678b75fe095', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0571044-e3c5-4316-95c6-0302a673d0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:44 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Volume volume-328d0ad5-f72b-447a-a9a3-f678b75fe095 (328d0ad5-f72b-447a-a9a3-f678b75fe095): created successfully
Jul 03 13:21:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0571044-e3c5-4316-95c6-0302a673d0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Flow 'volume_create_manager' (58bc4aaf-6df7-4ef2-9399-8dfa8434f673) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:21:44 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-353975d4-c463-4e14-af58-59a4c266529e tempest-CreateVolumesFromImageTest-323147659 None] Created volume successfully.
Jul 03 13:21:45 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-57e748c9-8ee4-40e3-9d32-708b73b2261a 1073741824" returned: 0 in 0.791s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-57e748c9-8ee4-40e3-9d32-708b73b2261a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:45 devstack sudo[105966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-57e748c9-8ee4-40e3-9d32-708b73b2261a
Jul 03 13:21:45 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:46 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-57e748c9-8ee4-40e3-9d32-708b73b2261a" returned: 0 in 0.621s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:46 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:21:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:46 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ed3156-7c9f-437a-9cae-17b83bc64917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57e748c9-8ee4-40e3-9d32-708b73b2261a', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:46 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d18915-6538-4e29-a263-f9b7886517a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:21:46 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Volume volume-57e748c9-8ee4-40e3-9d32-708b73b2261a (57e748c9-8ee4-40e3-9d32-708b73b2261a): created successfully
Jul 03 13:21:46 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d18915-6538-4e29-a263-f9b7886517a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:21:46 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Flow 'volume_create_manager' (f116cfbc-ab90-4c63-9fc6-bf8405e1a751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:21:46 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-ce5a731f-9ea1-424f-8111-695f73e93a47 tempest-CreateVolumesFromImageTest-323147659 None] Created volume successfully.
Jul 03 13:21:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-018ba1bb-5355-42f3-a7b0-a66577041b19 tempest-CreateVolumesFromImageTest-323147659 None] Acquiring lock "cinder-57e748c9-8ee4-40e3-9d32-708b73b2261a-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-018ba1bb-5355-42f3-a7b0-a66577041b19 tempest-CreateVolumesFromImageTest-323147659 None] Lock "cinder-57e748c9-8ee4-40e3-9d32-708b73b2261a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-018ba1bb-5355-42f3-a7b0-a66577041b19 tempest-CreateVolumesFromImageTest-323147659 None] Acquiring lock "cinder-quobyte-57e748c9-8ee4-40e3-9d32-708b73b2261a" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-018ba1bb-5355-42f3-a7b0-a66577041b19 tempest-CreateVolumesFromImageTest-323147659 None] Lock "cinder-quobyte-57e748c9-8ee4-40e3-9d32-708b73b2261a" acquired by "delete_volume" :: waited 0.016s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:47 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d00369f-7997-48de-aa6a-cfac0b661bb4]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:21:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-018ba1bb-5355-42f3-a7b0-a66577041b19 tempest-CreateVolumesFromImageTest-323147659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-57e748c9-8ee4-40e3-9d32-708b73b2261a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:47 devstack sudo[105977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-57e748c9-8ee4-40e3-9d32-708b73b2261a
Jul 03 13:21:47 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:48 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-018ba1bb-5355-42f3-a7b0-a66577041b19 tempest-CreateVolumesFromImageTest-323147659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-57e748c9-8ee4-40e3-9d32-708b73b2261a" returned: 0 in 0.780s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-018ba1bb-5355-42f3-a7b0-a66577041b19 tempest-CreateVolumesFromImageTest-323147659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-57e748c9-8ee4-40e3-9d32-708b73b2261a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:48 devstack sudo[105982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-57e748c9-8ee4-40e3-9d32-708b73b2261a
Jul 03 13:21:48 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:48 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-018ba1bb-5355-42f3-a7b0-a66577041b19 tempest-CreateVolumesFromImageTest-323147659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-57e748c9-8ee4-40e3-9d32-708b73b2261a" returned: 0 in 0.638s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:48 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-018ba1bb-5355-42f3-a7b0-a66577041b19 tempest-CreateVolumesFromImageTest-323147659 None] Lock "cinder-quobyte-57e748c9-8ee4-40e3-9d32-708b73b2261a" released by "delete_volume" :: held 1.455s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:48 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-018ba1bb-5355-42f3-a7b0-a66577041b19 tempest-CreateVolumesFromImageTest-323147659 None] Created reservations ['74820706-2171-4c24-8beb-eeae67dfaa07', 'a5131111-faf4-4125-8169-a9ec797552f1', '5362d461-2d4f-4a9d-94d3-1d6fbe3799de', '4ac59cac-7f40-4ab4-93f5-f005454164ce'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:21:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-018ba1bb-5355-42f3-a7b0-a66577041b19 tempest-CreateVolumesFromImageTest-323147659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-018ba1bb-5355-42f3-a7b0-a66577041b19 tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-018ba1bb-5355-42f3-a7b0-a66577041b19 tempest-CreateVolumesFromImageTest-323147659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:21:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-018ba1bb-5355-42f3-a7b0-a66577041b19 tempest-CreateVolumesFromImageTest-323147659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:21:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-018ba1bb-5355-42f3-a7b0-a66577041b19 tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-018ba1bb-5355-42f3-a7b0-a66577041b19 tempest-CreateVolumesFromImageTest-323147659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:49 devstack sudo[106009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:21:49 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b45a23c0-e1ae-4775-a2ff-3be535a8fe71 tempest-CreateVolumesFromImageTest-323147659 None] Acquiring lock "cinder-328d0ad5-f72b-447a-a9a3-f678b75fe095-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b45a23c0-e1ae-4775-a2ff-3be535a8fe71 tempest-CreateVolumesFromImageTest-323147659 None] Lock "cinder-328d0ad5-f72b-447a-a9a3-f678b75fe095-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:49 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-018ba1bb-5355-42f3-a7b0-a66577041b19 tempest-CreateVolumesFromImageTest-323147659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.655s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:49 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-018ba1bb-5355-42f3-a7b0-a66577041b19 tempest-CreateVolumesFromImageTest-323147659 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:21:49 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-018ba1bb-5355-42f3-a7b0-a66577041b19 tempest-CreateVolumesFromImageTest-323147659 None] Deleted volume successfully.
Jul 03 13:21:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b45a23c0-e1ae-4775-a2ff-3be535a8fe71 tempest-CreateVolumesFromImageTest-323147659 None] Acquiring lock "cinder-quobyte-328d0ad5-f72b-447a-a9a3-f678b75fe095" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b45a23c0-e1ae-4775-a2ff-3be535a8fe71 tempest-CreateVolumesFromImageTest-323147659 None] Lock "cinder-quobyte-328d0ad5-f72b-447a-a9a3-f678b75fe095" acquired by "delete_volume" :: waited 0.017s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-018ba1bb-5355-42f3-a7b0-a66577041b19 tempest-CreateVolumesFromImageTest-323147659 None] Lock "cinder-57e748c9-8ee4-40e3-9d32-708b73b2261a-delete_volume" released by "delete_volume" :: held 2.317s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:49 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe12fd2-214e-402e-8e00-2cc0d6352dad]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:21:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b45a23c0-e1ae-4775-a2ff-3be535a8fe71 tempest-CreateVolumesFromImageTest-323147659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-328d0ad5-f72b-447a-a9a3-f678b75fe095 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:49 devstack sudo[106012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-328d0ad5-f72b-447a-a9a3-f678b75fe095
Jul 03 13:21:49 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:50 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b45a23c0-e1ae-4775-a2ff-3be535a8fe71 tempest-CreateVolumesFromImageTest-323147659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-328d0ad5-f72b-447a-a9a3-f678b75fe095" returned: 0 in 0.763s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b45a23c0-e1ae-4775-a2ff-3be535a8fe71 tempest-CreateVolumesFromImageTest-323147659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-328d0ad5-f72b-447a-a9a3-f678b75fe095 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:50 devstack sudo[106017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-328d0ad5-f72b-447a-a9a3-f678b75fe095
Jul 03 13:21:50 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:51 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b45a23c0-e1ae-4775-a2ff-3be535a8fe71 tempest-CreateVolumesFromImageTest-323147659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-328d0ad5-f72b-447a-a9a3-f678b75fe095" returned: 0 in 0.638s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:51 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b45a23c0-e1ae-4775-a2ff-3be535a8fe71 tempest-CreateVolumesFromImageTest-323147659 None] Lock "cinder-quobyte-328d0ad5-f72b-447a-a9a3-f678b75fe095" released by "delete_volume" :: held 1.439s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:51 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-b45a23c0-e1ae-4775-a2ff-3be535a8fe71 tempest-CreateVolumesFromImageTest-323147659 None] Created reservations ['f475752f-e326-4e3d-9781-4c3a403f322e', '62c36907-6001-4469-a02d-78242d957da9', 'b809146c-a86e-42dc-bbaa-2946b525ede4', 'ee771e1a-2708-4664-b600-91a0cf25e1bf'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:21:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b45a23c0-e1ae-4775-a2ff-3be535a8fe71 tempest-CreateVolumesFromImageTest-323147659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b45a23c0-e1ae-4775-a2ff-3be535a8fe71 tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b45a23c0-e1ae-4775-a2ff-3be535a8fe71 tempest-CreateVolumesFromImageTest-323147659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:21:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b45a23c0-e1ae-4775-a2ff-3be535a8fe71 tempest-CreateVolumesFromImageTest-323147659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:21:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b45a23c0-e1ae-4775-a2ff-3be535a8fe71 tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b45a23c0-e1ae-4775-a2ff-3be535a8fe71 tempest-CreateVolumesFromImageTest-323147659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:51 devstack sudo[106020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:21:51 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:51 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f53afc64-c248-4ce7-b85b-adc814d4b2a6 tempest-CreateVolumesFromImageTest-323147659 None] Acquiring lock "cinder-22112da6-2901-43e8-a5b7-0c15c0287d7b-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:51 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f53afc64-c248-4ce7-b85b-adc814d4b2a6 tempest-CreateVolumesFromImageTest-323147659 None] Lock "cinder-22112da6-2901-43e8-a5b7-0c15c0287d7b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:51 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f53afc64-c248-4ce7-b85b-adc814d4b2a6 tempest-CreateVolumesFromImageTest-323147659 None] Acquiring lock "cinder-quobyte-22112da6-2901-43e8-a5b7-0c15c0287d7b" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:51 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b45a23c0-e1ae-4775-a2ff-3be535a8fe71 tempest-CreateVolumesFromImageTest-323147659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.692s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:51 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-b45a23c0-e1ae-4775-a2ff-3be535a8fe71 tempest-CreateVolumesFromImageTest-323147659 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:21:51 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-b45a23c0-e1ae-4775-a2ff-3be535a8fe71 tempest-CreateVolumesFromImageTest-323147659 None] Deleted volume successfully.
Jul 03 13:21:51 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f53afc64-c248-4ce7-b85b-adc814d4b2a6 tempest-CreateVolumesFromImageTest-323147659 None] Lock "cinder-quobyte-22112da6-2901-43e8-a5b7-0c15c0287d7b" acquired by "delete_volume" :: waited 0.027s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:52 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce77d393-cb5c-4795-af96-e9f50830e55e]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:21:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f53afc64-c248-4ce7-b85b-adc814d4b2a6 tempest-CreateVolumesFromImageTest-323147659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-22112da6-2901-43e8-a5b7-0c15c0287d7b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:52 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b45a23c0-e1ae-4775-a2ff-3be535a8fe71 tempest-CreateVolumesFromImageTest-323147659 None] Lock "cinder-328d0ad5-f72b-447a-a9a3-f678b75fe095-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:52 devstack sudo[106023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-22112da6-2901-43e8-a5b7-0c15c0287d7b
Jul 03 13:21:52 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:52 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f53afc64-c248-4ce7-b85b-adc814d4b2a6 tempest-CreateVolumesFromImageTest-323147659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-22112da6-2901-43e8-a5b7-0c15c0287d7b" returned: 0 in 0.756s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f53afc64-c248-4ce7-b85b-adc814d4b2a6 tempest-CreateVolumesFromImageTest-323147659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-22112da6-2901-43e8-a5b7-0c15c0287d7b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:52 devstack sudo[106028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-22112da6-2901-43e8-a5b7-0c15c0287d7b
Jul 03 13:21:52 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:53 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f53afc64-c248-4ce7-b85b-adc814d4b2a6 tempest-CreateVolumesFromImageTest-323147659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-22112da6-2901-43e8-a5b7-0c15c0287d7b" returned: 0 in 0.667s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:53 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f53afc64-c248-4ce7-b85b-adc814d4b2a6 tempest-CreateVolumesFromImageTest-323147659 None] Lock "cinder-quobyte-22112da6-2901-43e8-a5b7-0c15c0287d7b" released by "delete_volume" :: held 1.463s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:53 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-f53afc64-c248-4ce7-b85b-adc814d4b2a6 tempest-CreateVolumesFromImageTest-323147659 None] Created reservations ['10fd92e5-4381-4b82-96f7-92ed90966d98', '6cdd8222-6e4a-403c-8b76-4ecd383782e3', '3efcff01-0c56-4993-976b-0b64e51295a2', '208a62bf-1ee7-46d3-8ae3-5aac48fdd672'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:21:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f53afc64-c248-4ce7-b85b-adc814d4b2a6 tempest-CreateVolumesFromImageTest-323147659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f53afc64-c248-4ce7-b85b-adc814d4b2a6 tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:53 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f53afc64-c248-4ce7-b85b-adc814d4b2a6 tempest-CreateVolumesFromImageTest-323147659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:21:53 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f53afc64-c248-4ce7-b85b-adc814d4b2a6 tempest-CreateVolumesFromImageTest-323147659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:21:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f53afc64-c248-4ce7-b85b-adc814d4b2a6 tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f53afc64-c248-4ce7-b85b-adc814d4b2a6 tempest-CreateVolumesFromImageTest-323147659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:53 devstack sudo[106032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:21:53 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:54 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-96524d05-c245-40f0-8533-86d09db268e4 tempest-CreateVolumesFromImageTest-323147659 None] Acquiring lock "cinder-c512cd4a-eae7-4eee-8151-d3eef4c3795d-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:54 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-96524d05-c245-40f0-8533-86d09db268e4 tempest-CreateVolumesFromImageTest-323147659 None] Lock "cinder-c512cd4a-eae7-4eee-8151-d3eef4c3795d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:54 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-96524d05-c245-40f0-8533-86d09db268e4 tempest-CreateVolumesFromImageTest-323147659 None] Acquiring lock "cinder-quobyte-c512cd4a-eae7-4eee-8151-d3eef4c3795d" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:54 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-96524d05-c245-40f0-8533-86d09db268e4 tempest-CreateVolumesFromImageTest-323147659 None] Lock "cinder-quobyte-c512cd4a-eae7-4eee-8151-d3eef4c3795d" acquired by "delete_volume" :: waited 0.023s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:54 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcc1604-72f0-48d2-ab46-bad035895c70]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:21:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-96524d05-c245-40f0-8533-86d09db268e4 tempest-CreateVolumesFromImageTest-323147659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c512cd4a-eae7-4eee-8151-d3eef4c3795d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:54 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f53afc64-c248-4ce7-b85b-adc814d4b2a6 tempest-CreateVolumesFromImageTest-323147659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.691s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:54 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f53afc64-c248-4ce7-b85b-adc814d4b2a6 tempest-CreateVolumesFromImageTest-323147659 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:21:54 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-f53afc64-c248-4ce7-b85b-adc814d4b2a6 tempest-CreateVolumesFromImageTest-323147659 None] Deleted volume successfully.
Jul 03 13:21:54 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f53afc64-c248-4ce7-b85b-adc814d4b2a6 tempest-CreateVolumesFromImageTest-323147659 None] Lock "cinder-22112da6-2901-43e8-a5b7-0c15c0287d7b-delete_volume" released by "delete_volume" :: held 2.364s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:54 devstack sudo[106035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c512cd4a-eae7-4eee-8151-d3eef4c3795d
Jul 03 13:21:54 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:55 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-96524d05-c245-40f0-8533-86d09db268e4 tempest-CreateVolumesFromImageTest-323147659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c512cd4a-eae7-4eee-8151-d3eef4c3795d" returned: 0 in 0.777s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-96524d05-c245-40f0-8533-86d09db268e4 tempest-CreateVolumesFromImageTest-323147659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c512cd4a-eae7-4eee-8151-d3eef4c3795d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:55 devstack sudo[106040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c512cd4a-eae7-4eee-8151-d3eef4c3795d
Jul 03 13:21:55 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:55 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-96524d05-c245-40f0-8533-86d09db268e4 tempest-CreateVolumesFromImageTest-323147659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c512cd4a-eae7-4eee-8151-d3eef4c3795d" returned: 0 in 0.692s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-96524d05-c245-40f0-8533-86d09db268e4 tempest-CreateVolumesFromImageTest-323147659 None] Lock "cinder-quobyte-c512cd4a-eae7-4eee-8151-d3eef4c3795d" released by "delete_volume" :: held 1.509s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:55 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-96524d05-c245-40f0-8533-86d09db268e4 tempest-CreateVolumesFromImageTest-323147659 None] Created reservations ['8518e567-9d57-4136-88ea-e336268a5143', '79b5893f-b73b-4583-b1af-97e40329ae18', '8a4fee68-9003-473c-8ded-ab511e2d3df3', '71f49bbb-c279-437f-ab06-65524ee73a71'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:21:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-96524d05-c245-40f0-8533-86d09db268e4 tempest-CreateVolumesFromImageTest-323147659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-96524d05-c245-40f0-8533-86d09db268e4 tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:55 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-96524d05-c245-40f0-8533-86d09db268e4 tempest-CreateVolumesFromImageTest-323147659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:21:55 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-96524d05-c245-40f0-8533-86d09db268e4 tempest-CreateVolumesFromImageTest-323147659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:21:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-96524d05-c245-40f0-8533-86d09db268e4 tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-96524d05-c245-40f0-8533-86d09db268e4 tempest-CreateVolumesFromImageTest-323147659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:55 devstack sudo[106043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:21:55 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:56 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e29a89b7-50df-4457-83c7-7e6b4f29ce3c tempest-CreateVolumesFromImageTest-323147659 None] Acquiring lock "cinder-c6cb4e02-7ac9-49ac-9a8e-62edbaaa037b-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:56 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e29a89b7-50df-4457-83c7-7e6b4f29ce3c tempest-CreateVolumesFromImageTest-323147659 None] Lock "cinder-c6cb4e02-7ac9-49ac-9a8e-62edbaaa037b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:56 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e29a89b7-50df-4457-83c7-7e6b4f29ce3c tempest-CreateVolumesFromImageTest-323147659 None] Acquiring lock "cinder-quobyte-c6cb4e02-7ac9-49ac-9a8e-62edbaaa037b" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:21:56 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e29a89b7-50df-4457-83c7-7e6b4f29ce3c tempest-CreateVolumesFromImageTest-323147659 None] Lock "cinder-quobyte-c6cb4e02-7ac9-49ac-9a8e-62edbaaa037b" acquired by "delete_volume" :: waited 0.022s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:21:56 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-96524d05-c245-40f0-8533-86d09db268e4 tempest-CreateVolumesFromImageTest-323147659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.686s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:56 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-96524d05-c245-40f0-8533-86d09db268e4 tempest-CreateVolumesFromImageTest-323147659 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:21:56 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-96524d05-c245-40f0-8533-86d09db268e4 tempest-CreateVolumesFromImageTest-323147659 None] Deleted volume successfully.
Jul 03 13:21:56 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[676d793d-57c3-4f3f-8781-d75ec4f71229]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:21:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e29a89b7-50df-4457-83c7-7e6b4f29ce3c tempest-CreateVolumesFromImageTest-323147659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c6cb4e02-7ac9-49ac-9a8e-62edbaaa037b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:56 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-96524d05-c245-40f0-8533-86d09db268e4 tempest-CreateVolumesFromImageTest-323147659 None] Lock "cinder-c512cd4a-eae7-4eee-8151-d3eef4c3795d-delete_volume" released by "delete_volume" :: held 2.429s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:56 devstack sudo[106046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c6cb4e02-7ac9-49ac-9a8e-62edbaaa037b
Jul 03 13:21:56 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:57 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e29a89b7-50df-4457-83c7-7e6b4f29ce3c tempest-CreateVolumesFromImageTest-323147659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c6cb4e02-7ac9-49ac-9a8e-62edbaaa037b" returned: 0 in 0.736s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e29a89b7-50df-4457-83c7-7e6b4f29ce3c tempest-CreateVolumesFromImageTest-323147659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c6cb4e02-7ac9-49ac-9a8e-62edbaaa037b {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:57 devstack sudo[106051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c6cb4e02-7ac9-49ac-9a8e-62edbaaa037b
Jul 03 13:21:57 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:57 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e29a89b7-50df-4457-83c7-7e6b4f29ce3c tempest-CreateVolumesFromImageTest-323147659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c6cb4e02-7ac9-49ac-9a8e-62edbaaa037b" returned: 0 in 0.650s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e29a89b7-50df-4457-83c7-7e6b4f29ce3c tempest-CreateVolumesFromImageTest-323147659 None] Lock "cinder-quobyte-c6cb4e02-7ac9-49ac-9a8e-62edbaaa037b" released by "delete_volume" :: held 1.431s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:21:57 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-e29a89b7-50df-4457-83c7-7e6b4f29ce3c tempest-CreateVolumesFromImageTest-323147659 None] Created reservations ['2340e9db-9c4d-4fd7-9512-07de1204cde9', '31861468-55b6-415f-802c-233f481f2157', '4125c56a-65b8-4c0e-98a2-5ef3f07100e6', '9313586a-1440-4e40-90da-205e9975d74a'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:21:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e29a89b7-50df-4457-83c7-7e6b4f29ce3c tempest-CreateVolumesFromImageTest-323147659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:21:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e29a89b7-50df-4457-83c7-7e6b4f29ce3c tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:21:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e29a89b7-50df-4457-83c7-7e6b4f29ce3c tempest-CreateVolumesFromImageTest-323147659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:21:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e29a89b7-50df-4457-83c7-7e6b4f29ce3c tempest-CreateVolumesFromImageTest-323147659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:21:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e29a89b7-50df-4457-83c7-7e6b4f29ce3c tempest-CreateVolumesFromImageTest-323147659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:21:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e29a89b7-50df-4457-83c7-7e6b4f29ce3c tempest-CreateVolumesFromImageTest-323147659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:21:58 devstack sudo[106055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:21:58 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:21:58 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root
Jul 03 13:21:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e29a89b7-50df-4457-83c7-7e6b4f29ce3c tempest-CreateVolumesFromImageTest-323147659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.643s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:21:58 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-e29a89b7-50df-4457-83c7-7e6b4f29ce3c tempest-CreateVolumesFromImageTest-323147659 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:21:58 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-e29a89b7-50df-4457-83c7-7e6b4f29ce3c tempest-CreateVolumesFromImageTest-323147659 None] Deleted volume successfully.
Jul 03 13:21:58 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e29a89b7-50df-4457-83c7-7e6b4f29ce3c tempest-CreateVolumesFromImageTest-323147659 None] Lock "cinder-c6cb4e02-7ac9-49ac-9a8e-62edbaaa037b-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:22:02 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:22:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Flow 'volume_create_manager' (ef62e4f8-1b87-493b-aa57-e178d73375f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:22:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42347aba-3b3d-4fe7-abc3-47240b545f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42347aba-3b3d-4fe7-abc3-47240b545f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1579578769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=425f1cfc-0703-458d-8775-546b99b19272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b3cbd4b0ba54a3a82ab925d2ddbe087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:22:02Z,use_quota=True,user_id='cbf149fa32784411b54468a17556c896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79f9c80-129b-4af2-9b26-7e6db7262655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79f9c80-129b-4af2-9b26-7e6db7262655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1788ebd-771e-4582-85a0-f7af0e658aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1788ebd-771e-4582-85a0-f7af0e658aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '425f1cfc-0703-458d-8775-546b99b19272', 'volume_name': 'volume-425f1cfc-0703-458d-8775-546b99b19272', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c7f82d-9475-4c42-aafe-c1abb1e9337f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c7f82d-9475-4c42-aafe-c1abb1e9337f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb6a9499-e2ec-4f0c-a92f-6168ae407674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:02 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Volume 425f1cfc-0703-458d-8775-546b99b19272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-425f1cfc-0703-458d-8775-546b99b19272', 'volume_size': 1}
Jul 03 13:22:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:22:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:22:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1579578769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=425f1cfc-0703-458d-8775-546b99b19272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b3cbd4b0ba54a3a82ab925d2ddbe087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:22:02Z,use_quota=True,user_id='cbf149fa32784411b54468a17556c896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:22:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Creating volume 425f1cfc-0703-458d-8775-546b99b19272 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:22:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:22:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:22:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:22:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:22:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:22:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:22:02 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:22:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-425f1cfc-0703-458d-8775-546b99b19272 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:02 devstack sudo[106061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-425f1cfc-0703-458d-8775-546b99b19272 1073741824
Jul 03 13:22:02 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:03 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-425f1cfc-0703-458d-8775-546b99b19272 1073741824" returned: 0 in 0.893s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-425f1cfc-0703-458d-8775-546b99b19272 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:03 devstack sudo[106068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-425f1cfc-0703-458d-8775-546b99b19272
Jul 03 13:22:03 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:03 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-425f1cfc-0703-458d-8775-546b99b19272" returned: 0 in 0.663s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:03 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:22:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:22:03 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb6a9499-e2ec-4f0c-a92f-6168ae407674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-425f1cfc-0703-458d-8775-546b99b19272', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:03 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d298e6a-af07-4ad0-8441-8db0fb452728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:03 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Volume volume-425f1cfc-0703-458d-8775-546b99b19272 (425f1cfc-0703-458d-8775-546b99b19272): created successfully
Jul 03 13:22:03 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d298e6a-af07-4ad0-8441-8db0fb452728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:03 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Flow 'volume_create_manager' (ef62e4f8-1b87-493b-aa57-e178d73375f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:22:03 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-00ecced2-0e17-4df2-8280-a7953091b17f tempest-ProjectReaderTests-1409966223 None] Created volume successfully.
Jul 03 13:22:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-eea749f4-16d6-4469-a652-b03f41f6c1a8 tempest-ProjectReaderTests-1409966223 None] Acquiring lock "cinder-425f1cfc-0703-458d-8775-546b99b19272-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:22:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-eea749f4-16d6-4469-a652-b03f41f6c1a8 tempest-ProjectReaderTests-1409966223 None] Lock "cinder-425f1cfc-0703-458d-8775-546b99b19272-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:22:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-eea749f4-16d6-4469-a652-b03f41f6c1a8 tempest-ProjectReaderTests-1409966223 None] Acquiring lock "cinder-quobyte-425f1cfc-0703-458d-8775-546b99b19272" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:22:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-eea749f4-16d6-4469-a652-b03f41f6c1a8 tempest-ProjectReaderTests-1409966223 None] Lock "cinder-quobyte-425f1cfc-0703-458d-8775-546b99b19272" acquired by "delete_volume" :: waited 0.018s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:22:04 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb4cde7-a42e-46d8-972a-5556625351e5]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:22:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-eea749f4-16d6-4469-a652-b03f41f6c1a8 tempest-ProjectReaderTests-1409966223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-425f1cfc-0703-458d-8775-546b99b19272 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:04 devstack sudo[106072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-425f1cfc-0703-458d-8775-546b99b19272
Jul 03 13:22:04 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:05 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-eea749f4-16d6-4469-a652-b03f41f6c1a8 tempest-ProjectReaderTests-1409966223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-425f1cfc-0703-458d-8775-546b99b19272" returned: 0 in 0.739s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-eea749f4-16d6-4469-a652-b03f41f6c1a8 tempest-ProjectReaderTests-1409966223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-425f1cfc-0703-458d-8775-546b99b19272 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:05 devstack sudo[106078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-425f1cfc-0703-458d-8775-546b99b19272
Jul 03 13:22:05 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:05 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-eea749f4-16d6-4469-a652-b03f41f6c1a8 tempest-ProjectReaderTests-1409966223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-425f1cfc-0703-458d-8775-546b99b19272" returned: 0 in 0.644s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:05 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-eea749f4-16d6-4469-a652-b03f41f6c1a8 tempest-ProjectReaderTests-1409966223 None] Lock "cinder-quobyte-425f1cfc-0703-458d-8775-546b99b19272" released by "delete_volume" :: held 1.425s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:22:05 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-eea749f4-16d6-4469-a652-b03f41f6c1a8 tempest-ProjectReaderTests-1409966223 None] Created reservations ['3f6649ff-b894-49fb-8722-3aa6cfc1e0c5', '74e3056f-0276-4490-89a5-0110e61ae909', '1dea9a21-01c3-41a4-89d7-912ca5af6469', '0b1d1262-b161-465f-8612-43331af100f1'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:22:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-eea749f4-16d6-4469-a652-b03f41f6c1a8 tempest-ProjectReaderTests-1409966223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:22:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-eea749f4-16d6-4469-a652-b03f41f6c1a8 tempest-ProjectReaderTests-1409966223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:22:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-eea749f4-16d6-4469-a652-b03f41f6c1a8 tempest-ProjectReaderTests-1409966223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:22:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-eea749f4-16d6-4469-a652-b03f41f6c1a8 tempest-ProjectReaderTests-1409966223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:22:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-eea749f4-16d6-4469-a652-b03f41f6c1a8 tempest-ProjectReaderTests-1409966223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:22:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-eea749f4-16d6-4469-a652-b03f41f6c1a8 tempest-ProjectReaderTests-1409966223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:06 devstack sudo[106081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:22:06 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:06 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-eea749f4-16d6-4469-a652-b03f41f6c1a8 tempest-ProjectReaderTests-1409966223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.696s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:06 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-eea749f4-16d6-4469-a652-b03f41f6c1a8 tempest-ProjectReaderTests-1409966223 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:22:06 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-eea749f4-16d6-4469-a652-b03f41f6c1a8 tempest-ProjectReaderTests-1409966223 None] Deleted volume successfully.
Jul 03 13:22:06 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-eea749f4-16d6-4469-a652-b03f41f6c1a8 tempest-ProjectReaderTests-1409966223 None] Lock "cinder-425f1cfc-0703-458d-8775-546b99b19272-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:22:07 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:22:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Flow 'volume_create_manager' (fcbe3dd9-7b4c-4131-b0e2-8da392561e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:22:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00dbf0a-fb2a-4563-8d7c-bf22d8f961d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00dbf0a-fb2a-4563-8d7c-bf22d8f961d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1514536132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e751679-70c2-48b0-9f13-eef363b077ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b3cbd4b0ba54a3a82ab925d2ddbe087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:22:07Z,use_quota=True,user_id='cbf149fa32784411b54468a17556c896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4698ddd-f1ef-439f-8dd7-559e7a43b8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4698ddd-f1ef-439f-8dd7-559e7a43b8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69a3d4e1-526c-4ed5-8200-3ccf339244ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69a3d4e1-526c-4ed5-8200-3ccf339244ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e751679-70c2-48b0-9f13-eef363b077ad', 'volume_name': 'volume-4e751679-70c2-48b0-9f13-eef363b077ad', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b06717-a74c-4cd8-a090-5a8a09feb358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b06717-a74c-4cd8-a090-5a8a09feb358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74bb98cd-b00d-4da9-97c6-293d3f653fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:07 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Volume 4e751679-70c2-48b0-9f13-eef363b077ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e751679-70c2-48b0-9f13-eef363b077ad', 'volume_size': 1}
Jul 03 13:22:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:22:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:22:07 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1514536132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e751679-70c2-48b0-9f13-eef363b077ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b3cbd4b0ba54a3a82ab925d2ddbe087',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:22:07Z,use_quota=True,user_id='cbf149fa32784411b54468a17556c896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:22:07 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Creating volume 4e751679-70c2-48b0-9f13-eef363b077ad {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:22:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:22:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:22:07 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:22:07 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:22:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:22:07 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:22:07 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:22:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4e751679-70c2-48b0-9f13-eef363b077ad 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:07 devstack sudo[106084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4e751679-70c2-48b0-9f13-eef363b077ad 1073741824
Jul 03 13:22:07 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:07 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4e751679-70c2-48b0-9f13-eef363b077ad 1073741824" returned: 0 in 0.815s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4e751679-70c2-48b0-9f13-eef363b077ad {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:08 devstack sudo[106090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4e751679-70c2-48b0-9f13-eef363b077ad
Jul 03 13:22:08 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:08 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4e751679-70c2-48b0-9f13-eef363b077ad" returned: 0 in 0.673s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:22:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:22:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74bb98cd-b00d-4da9-97c6-293d3f653fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e751679-70c2-48b0-9f13-eef363b077ad', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46318858-92f8-43b0-ad2b-28fa6474c1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:08 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Volume volume-4e751679-70c2-48b0-9f13-eef363b077ad (4e751679-70c2-48b0-9f13-eef363b077ad): created successfully
Jul 03 13:22:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46318858-92f8-43b0-ad2b-28fa6474c1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Flow 'volume_create_manager' (fcbe3dd9-7b4c-4131-b0e2-8da392561e61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:22:08 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-51face58-a081-434f-b9d2-ff774c2547ed tempest-ProjectReaderTests-1409966223 None] Created volume successfully.
Jul 03 13:22:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9171befe-6676-4f4c-8272-ffb4b4bcb788 tempest-ProjectReaderTests-1409966223 None] Acquiring lock "cinder-4e751679-70c2-48b0-9f13-eef363b077ad-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:22:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9171befe-6676-4f4c-8272-ffb4b4bcb788 tempest-ProjectReaderTests-1409966223 None] Lock "cinder-4e751679-70c2-48b0-9f13-eef363b077ad-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:22:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9171befe-6676-4f4c-8272-ffb4b4bcb788 tempest-ProjectReaderTests-1409966223 None] Acquiring lock "cinder-quobyte-4e751679-70c2-48b0-9f13-eef363b077ad" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:22:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9171befe-6676-4f4c-8272-ffb4b4bcb788 tempest-ProjectReaderTests-1409966223 None] Lock "cinder-quobyte-4e751679-70c2-48b0-9f13-eef363b077ad" acquired by "delete_volume" :: waited 0.017s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:22:09 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a5ec7d-4bff-4b78-8e35-820f07c3a35c]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:22:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9171befe-6676-4f4c-8272-ffb4b4bcb788 tempest-ProjectReaderTests-1409966223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4e751679-70c2-48b0-9f13-eef363b077ad {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:09 devstack sudo[106093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4e751679-70c2-48b0-9f13-eef363b077ad
Jul 03 13:22:09 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:10 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9171befe-6676-4f4c-8272-ffb4b4bcb788 tempest-ProjectReaderTests-1409966223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4e751679-70c2-48b0-9f13-eef363b077ad" returned: 0 in 0.844s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9171befe-6676-4f4c-8272-ffb4b4bcb788 tempest-ProjectReaderTests-1409966223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4e751679-70c2-48b0-9f13-eef363b077ad {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:10 devstack sudo[106102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4e751679-70c2-48b0-9f13-eef363b077ad
Jul 03 13:22:10 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:10 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9171befe-6676-4f4c-8272-ffb4b4bcb788 tempest-ProjectReaderTests-1409966223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4e751679-70c2-48b0-9f13-eef363b077ad" returned: 0 in 0.769s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:10 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9171befe-6676-4f4c-8272-ffb4b4bcb788 tempest-ProjectReaderTests-1409966223 None] Lock "cinder-quobyte-4e751679-70c2-48b0-9f13-eef363b077ad" released by "delete_volume" :: held 1.658s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:22:10 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-9171befe-6676-4f4c-8272-ffb4b4bcb788 tempest-ProjectReaderTests-1409966223 None] Created reservations ['bf1e544a-094a-40f0-80e8-e74ce819455f', '97ad6b5a-09fe-4270-81f2-01f5803ae7b9', '35c9e18d-6592-4549-b7d4-032026bbc867', '08f7f8fc-1b1d-4c97-bc54-71cc42c3ec94'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:22:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9171befe-6676-4f4c-8272-ffb4b4bcb788 tempest-ProjectReaderTests-1409966223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:22:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9171befe-6676-4f4c-8272-ffb4b4bcb788 tempest-ProjectReaderTests-1409966223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:22:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9171befe-6676-4f4c-8272-ffb4b4bcb788 tempest-ProjectReaderTests-1409966223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:22:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9171befe-6676-4f4c-8272-ffb4b4bcb788 tempest-ProjectReaderTests-1409966223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:22:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9171befe-6676-4f4c-8272-ffb4b4bcb788 tempest-ProjectReaderTests-1409966223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:22:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9171befe-6676-4f4c-8272-ffb4b4bcb788 tempest-ProjectReaderTests-1409966223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:11 devstack sudo[106108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:22:11 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:11 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9171befe-6676-4f4c-8272-ffb4b4bcb788 tempest-ProjectReaderTests-1409966223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.829s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:11 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-9171befe-6676-4f4c-8272-ffb4b4bcb788 tempest-ProjectReaderTests-1409966223 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:22:11 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-9171befe-6676-4f4c-8272-ffb4b4bcb788 tempest-ProjectReaderTests-1409966223 None] Deleted volume successfully.
Jul 03 13:22:11 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9171befe-6676-4f4c-8272-ffb4b4bcb788 tempest-ProjectReaderTests-1409966223 None] Lock "cinder-4e751679-70c2-48b0-9f13-eef363b077ad-delete_volume" released by "delete_volume" :: held 2.772s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:22:14 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-74bfe68b-209f-44d3-a853-cfd08597fa70 req-46f90935-3f66-414e-8c72-56f0fd68f8e3 tempest-TestShelveInstance-1358354005 None] Terminate volume connection completed successfully.
Jul 03 13:22:14 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [req-74bfe68b-209f-44d3-a853-cfd08597fa70 req-46f90935-3f66-414e-8c72-56f0fd68f8e3 tempest-TestShelveInstance-1358354005 None] Deleting attachment e2eb9bd1-7fc7-4fd7-8be8-7005c4d4d967. {{(pid=86837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 13:22:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:22:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:22:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:22:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:22:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:22:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:22:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:15 devstack sudo[106153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:22:15 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:15 devstack cinder-volume[86837]: DEBUG cinder.coordination [req-74bfe68b-209f-44d3-a853-cfd08597fa70 req-7824ab56-fa8f-4f2e-a46a-aec7047d914f tempest-TestShelveInstance-1358354005 None] Acquiring lock "cinder-5b965dc5-388b-4b31-9733-256f38bd47cc-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:22:15 devstack cinder-volume[86837]: DEBUG cinder.coordination [req-74bfe68b-209f-44d3-a853-cfd08597fa70 req-7824ab56-fa8f-4f2e-a46a-aec7047d914f tempest-TestShelveInstance-1358354005 None] Lock "cinder-5b965dc5-388b-4b31-9733-256f38bd47cc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:22:15 devstack cinder-volume[86837]: DEBUG cinder.coordination [req-74bfe68b-209f-44d3-a853-cfd08597fa70 req-7824ab56-fa8f-4f2e-a46a-aec7047d914f tempest-TestShelveInstance-1358354005 None] Acquiring lock "cinder-quobyte-5b965dc5-388b-4b31-9733-256f38bd47cc" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:22:15 devstack cinder-volume[86837]: DEBUG cinder.coordination [req-74bfe68b-209f-44d3-a853-cfd08597fa70 req-7824ab56-fa8f-4f2e-a46a-aec7047d914f tempest-TestShelveInstance-1358354005 None] Lock "cinder-quobyte-5b965dc5-388b-4b31-9733-256f38bd47cc" acquired by "delete_volume" :: waited 0.025s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:22:15 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.729s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:15 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:22:15 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:22:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 28 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:22:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>, <Thread(tpool_thread_0, started daemon 134850092431040)>, <Thread(tpool_thread_1, started daemon 134850084021952)>, <Thread(tpool_thread_2, started daemon 134850075612864)>, <Thread(tpool_thread_3, started daemon 134850067203776)>, <Thread(tpool_thread_4, started daemon 134850058794688)>, <Thread(tpool_thread_5, started daemon 134850050385600)>, <Thread(tpool_thread_6, started daemon 134850041976512)>, <Thread(tpool_thread_7, started daemon 134850033567424)>, <Thread(tpool_thread_8, started daemon 134850025158336)>, <Thread(tpool_thread_9, started daemon 134850016749248)>, <Thread(tpool_thread_10, started daemon 134850008340160)>, <Thread(tpool_thread_11, started daemon 134849999931072)>, <Thread(tpool_thread_12, started daemon 134849991521984)>, <Thread(tpool_thread_13, started daemon 134849983112896)>, <Thread(tpool_thread_14, started daemon 134849974703808)>, <Thread(tpool_thread_15, started daemon 134849966294720)>, <Thread(tpool_thread_16, started daemon 134849957885632)>, <Thread(tpool_thread_17, started daemon 134849949476544)>, <Thread(tpool_thread_18, started daemon 134849941067456)>, <Thread(tpool_thread_19, started daemon 134849932658368)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:22:15 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e603df6a-bd9b-42f4-ac62-f72fd52013fe]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:22:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-74bfe68b-209f-44d3-a853-cfd08597fa70 req-7824ab56-fa8f-4f2e-a46a-aec7047d914f tempest-TestShelveInstance-1358354005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:15 devstack sudo[106156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc
Jul 03 13:22:15 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:16 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-74bfe68b-209f-44d3-a853-cfd08597fa70 req-7824ab56-fa8f-4f2e-a46a-aec7047d914f tempest-TestShelveInstance-1358354005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc" returned: 0 in 0.835s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-74bfe68b-209f-44d3-a853-cfd08597fa70 req-7824ab56-fa8f-4f2e-a46a-aec7047d914f tempest-TestShelveInstance-1358354005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:16 devstack sudo[106160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc
Jul 03 13:22:16 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:17 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-74bfe68b-209f-44d3-a853-cfd08597fa70 req-7824ab56-fa8f-4f2e-a46a-aec7047d914f tempest-TestShelveInstance-1358354005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc" returned: 1 in 0.806s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-74bfe68b-209f-44d3-a853-cfd08597fa70 req-7824ab56-fa8f-4f2e-a46a-aec7047d914f tempest-TestShelveInstance-1358354005 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:22:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-74bfe68b-209f-44d3-a853-cfd08597fa70 req-7824ab56-fa8f-4f2e-a46a-aec7047d914f tempest-TestShelveInstance-1358354005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:17 devstack sudo[106165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc
Jul 03 13:22:17 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:18 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-74bfe68b-209f-44d3-a853-cfd08597fa70 req-7824ab56-fa8f-4f2e-a46a-aec7047d914f tempest-TestShelveInstance-1358354005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-5b965dc5-388b-4b31-9733-256f38bd47cc" returned: 0 in 0.674s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:18 devstack cinder-volume[86837]: DEBUG cinder.coordination [req-74bfe68b-209f-44d3-a853-cfd08597fa70 req-7824ab56-fa8f-4f2e-a46a-aec7047d914f tempest-TestShelveInstance-1358354005 None] Lock "cinder-quobyte-5b965dc5-388b-4b31-9733-256f38bd47cc" released by "delete_volume" :: held 2.409s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:22:18 devstack cinder-volume[86837]: DEBUG cinder.quota [req-74bfe68b-209f-44d3-a853-cfd08597fa70 req-7824ab56-fa8f-4f2e-a46a-aec7047d914f tempest-TestShelveInstance-1358354005 None] Created reservations ['6237526c-4456-47c2-bca2-2cfacfea8d35', 'c2bd7cb2-7bde-41cd-945a-d0b04dcb05fc', 'f2ba2b00-a1f5-4488-a4d1-7d1de4a0fd74', 'bb2f2d90-04ca-40e5-948b-6350921b5db3'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:22:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-74bfe68b-209f-44d3-a853-cfd08597fa70 req-7824ab56-fa8f-4f2e-a46a-aec7047d914f tempest-TestShelveInstance-1358354005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:22:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-74bfe68b-209f-44d3-a853-cfd08597fa70 req-7824ab56-fa8f-4f2e-a46a-aec7047d914f tempest-TestShelveInstance-1358354005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:22:18 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [req-74bfe68b-209f-44d3-a853-cfd08597fa70 req-7824ab56-fa8f-4f2e-a46a-aec7047d914f tempest-TestShelveInstance-1358354005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:22:18 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [req-74bfe68b-209f-44d3-a853-cfd08597fa70 req-7824ab56-fa8f-4f2e-a46a-aec7047d914f tempest-TestShelveInstance-1358354005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:22:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [req-74bfe68b-209f-44d3-a853-cfd08597fa70 req-7824ab56-fa8f-4f2e-a46a-aec7047d914f tempest-TestShelveInstance-1358354005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:22:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-74bfe68b-209f-44d3-a853-cfd08597fa70 req-7824ab56-fa8f-4f2e-a46a-aec7047d914f tempest-TestShelveInstance-1358354005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:18 devstack sudo[106168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:22:18 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:18 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [req-74bfe68b-209f-44d3-a853-cfd08597fa70 req-7824ab56-fa8f-4f2e-a46a-aec7047d914f tempest-TestShelveInstance-1358354005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.745s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:18 devstack cinder-volume[86837]: DEBUG cinder.manager [req-74bfe68b-209f-44d3-a853-cfd08597fa70 req-7824ab56-fa8f-4f2e-a46a-aec7047d914f tempest-TestShelveInstance-1358354005 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:22:19 devstack cinder-volume[86837]: INFO cinder.volume.manager [req-74bfe68b-209f-44d3-a853-cfd08597fa70 req-7824ab56-fa8f-4f2e-a46a-aec7047d914f tempest-TestShelveInstance-1358354005 None] Deleted volume successfully.
Jul 03 13:22:19 devstack cinder-volume[86837]: DEBUG cinder.coordination [req-74bfe68b-209f-44d3-a853-cfd08597fa70 req-7824ab56-fa8f-4f2e-a46a-aec7047d914f tempest-TestShelveInstance-1358354005 None] Lock "cinder-5b965dc5-388b-4b31-9733-256f38bd47cc-delete_volume" released by "delete_volume" :: held 3.476s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:22:28 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=53,cinder:INSERT=19,cinder:UPDATE=86,cinder:DELETE=8 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:22:29 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=57,cinder:UPDATE=84,cinder:DELETE=7,cinder:INSERT=20 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:22:31 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:22:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Flow 'volume_create_manager' (91eed153-6c4c-47c3-930f-182b12617151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:22:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec775339-ca8d-4ab3-93c8-61cc554c76dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec775339-ca8d-4ab3-93c8-61cc554c76dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2098880386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28cc267f-1e4e-49ec-ba04-30c7f7666d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f9b0486fff4875aa0ca84bf787ceaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:22:31Z,use_quota=True,user_id='9b36b133527a4056ae9644ba31eb568c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41b52d65-dc7e-4166-b781-f0e79940df3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41b52d65-dc7e-4166-b781-f0e79940df3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e99626a-c845-417d-976c-d645481b1de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e99626a-c845-417d-976c-d645481b1de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28cc267f-1e4e-49ec-ba04-30c7f7666d65', 'volume_name': 'volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a30ca31-2a59-4eb2-8662-e32590d700c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a30ca31-2a59-4eb2-8662-e32590d700c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0deeffdd-fac0-4611-8cee-478768e9e531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:31 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Volume 28cc267f-1e4e-49ec-ba04-30c7f7666d65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65', 'volume_size': 1}
Jul 03 13:22:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:22:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:22:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2098880386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28cc267f-1e4e-49ec-ba04-30c7f7666d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f9b0486fff4875aa0ca84bf787ceaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:22:31Z,use_quota=True,user_id='9b36b133527a4056ae9644ba31eb568c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:22:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Creating volume 28cc267f-1e4e-49ec-ba04-30c7f7666d65 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:22:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:22:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:22:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:22:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:22:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:22:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:22:31 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:22:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:31 devstack sudo[106218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65 1073741824
Jul 03 13:22:31 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:32 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65 1073741824" returned: 0 in 0.838s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:32 devstack sudo[106224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65
Jul 03 13:22:32 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:32 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65" returned: 0 in 0.657s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:22:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:22:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0deeffdd-fac0-4611-8cee-478768e9e531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61db837b-15d9-416d-95fd-4ea6b7db1e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:32 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Volume volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65 (28cc267f-1e4e-49ec-ba04-30c7f7666d65): created successfully
Jul 03 13:22:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61db837b-15d9-416d-95fd-4ea6b7db1e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Flow 'volume_create_manager' (91eed153-6c4c-47c3-930f-182b12617151) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:22:32 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-5c190405-3493-4639-87c3-511cbaba6489 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Created volume successfully.
Jul 03 13:22:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-7e2a1739-8122-4a46-a656-5bc6871a4b6b tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:22:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-7e2a1739-8122-4a46-a656-5bc6871a4b6b tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:22:33 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-7e2a1739-8122-4a46-a656-5bc6871a4b6b tempest-CreateVolumesFromSnapshotTest-1073898006 None] Creating offline snapshot 3ab2ce5f-2be8-4f31-911a-e2fd21293c37 of volume 28cc267f-1e4e-49ec-ba04-30c7f7666d65 {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:22:33 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a99c719-9f9f-49cf-a637-c1d18deaee77]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:22:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7e2a1739-8122-4a46-a656-5bc6871a4b6b tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:33 devstack sudo[106228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65
Jul 03 13:22:33 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:34 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7e2a1739-8122-4a46-a656-5bc6871a4b6b tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65" returned: 0 in 0.736s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7e2a1739-8122-4a46-a656-5bc6871a4b6b tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65.3ab2ce5f-2be8-4f31-911a-e2fd21293c37 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:34 devstack sudo[106233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65.3ab2ce5f-2be8-4f31-911a-e2fd21293c37 1G
Jul 03 13:22:34 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:35 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7e2a1739-8122-4a46-a656-5bc6871a4b6b tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65.3ab2ce5f-2be8-4f31-911a-e2fd21293c37 1G" returned: 0 in 0.822s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7e2a1739-8122-4a46-a656-5bc6871a4b6b tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65.3ab2ce5f-2be8-4f31-911a-e2fd21293c37 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:35 devstack sudo[106239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65.3ab2ce5f-2be8-4f31-911a-e2fd21293c37
Jul 03 13:22:35 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:35 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7e2a1739-8122-4a46-a656-5bc6871a4b6b tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65.3ab2ce5f-2be8-4f31-911a-e2fd21293c37" returned: 0 in 0.675s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:35 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-7e2a1739-8122-4a46-a656-5bc6871a4b6b tempest-CreateVolumesFromSnapshotTest-1073898006 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65.3ab2ce5f-2be8-4f31-911a-e2fd21293c37 is being set with open permissions: ugo+rw
Jul 03 13:22:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7e2a1739-8122-4a46-a656-5bc6871a4b6b tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65.3ab2ce5f-2be8-4f31-911a-e2fd21293c37 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:35 devstack sudo[106244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65.3ab2ce5f-2be8-4f31-911a-e2fd21293c37
Jul 03 13:22:35 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:36 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7e2a1739-8122-4a46-a656-5bc6871a4b6b tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65.3ab2ce5f-2be8-4f31-911a-e2fd21293c37" returned: 0 in 0.661s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7e2a1739-8122-4a46-a656-5bc6871a4b6b tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:36 devstack sudo[106247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65.info
Jul 03 13:22:36 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:37 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7e2a1739-8122-4a46-a656-5bc6871a4b6b tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65.info" returned: 0 in 0.639s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:37 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-7e2a1739-8122-4a46-a656-5bc6871a4b6b tempest-CreateVolumesFromSnapshotTest-1073898006 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65.info is being set with open permissions: ugo+rw
Jul 03 13:22:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7e2a1739-8122-4a46-a656-5bc6871a4b6b tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:37 devstack sudo[106250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65.info
Jul 03 13:22:37 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:37 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7e2a1739-8122-4a46-a656-5bc6871a4b6b tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65.info" returned: 0 in 0.686s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-7e2a1739-8122-4a46-a656-5bc6871a4b6b tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.313s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:22:37 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-7e2a1739-8122-4a46-a656-5bc6871a4b6b tempest-CreateVolumesFromSnapshotTest-1073898006 None] Create snapshot completed successfully
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Flow 'volume_create_manager' (f1364dbd-162f-4d0b-a47d-72089a2849ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d81c2ee6-bdf6-435f-8d17-37b396e33a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d81c2ee6-bdf6-435f-8d17-37b396e33a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1865129463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe6c3af-4636-47a2-9b4e-f2e479b9ed54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f9b0486fff4875aa0ca84bf787ceaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:22:39Z,use_quota=True,user_id='9b36b133527a4056ae9644ba31eb568c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33b96de4-ed15-499d-b58d-7beca5aa2c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33b96de4-ed15-499d-b58d-7beca5aa2c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef6885f6-119b-4b44-9dfd-cb828269e122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef6885f6-119b-4b44-9dfd-cb828269e122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abe6c3af-4636-47a2-9b4e-f2e479b9ed54', 'volume_name': 'volume-abe6c3af-4636-47a2-9b4e-f2e479b9ed54', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44f1b845-60c5-4c7e-a0ae-7a716d5c82c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44f1b845-60c5-4c7e-a0ae-7a716d5c82c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269a37ec-5699-427c-920c-c2a5a2ca70f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:39 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Volume abe6c3af-4636-47a2-9b4e-f2e479b9ed54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abe6c3af-4636-47a2-9b4e-f2e479b9ed54', 'volume_size': 1}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1865129463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe6c3af-4636-47a2-9b4e-f2e479b9ed54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f9b0486fff4875aa0ca84bf787ceaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:22:39Z,use_quota=True,user_id='9b36b133527a4056ae9644ba31eb568c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Creating volume abe6c3af-4636-47a2-9b4e-f2e479b9ed54 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:22:39 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-abe6c3af-4636-47a2-9b4e-f2e479b9ed54 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:39 devstack sudo[106253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-abe6c3af-4636-47a2-9b4e-f2e479b9ed54 1073741824
Jul 03 13:22:39 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Flow 'volume_create_manager' (c9be342d-cbbd-4bef-b4c7-414564599243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a49f74-57d5-420d-b149-1b4ecf69e1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a49f74-57d5-420d-b149-1b4ecf69e1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-301628883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d3bd4ca-018a-4531-8c4e-c30ab964e0a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f9b0486fff4875aa0ca84bf787ceaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:22:39Z,use_quota=True,user_id='9b36b133527a4056ae9644ba31eb568c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0980a15f-fe68-4318-a206-002bc7828401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0980a15f-fe68-4318-a206-002bc7828401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43467b0-d58c-4254-b6ca-933d6b4d5e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43467b0-d58c-4254-b6ca-933d6b4d5e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d3bd4ca-018a-4531-8c4e-c30ab964e0a9', 'volume_name': 'volume-4d3bd4ca-018a-4531-8c4e-c30ab964e0a9', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa48cf73-b057-49dc-a6f6-fe7341696723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa48cf73-b057-49dc-a6f6-fe7341696723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (252de7f6-862e-4a20-836e-2ff7ac1544b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:39 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Volume 4d3bd4ca-018a-4531-8c4e-c30ab964e0a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d3bd4ca-018a-4531-8c4e-c30ab964e0a9', 'volume_size': 1}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Flow 'volume_create_manager' (ceff8cf2-3b8c-4f7c-996d-fbb40449e7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2d4680-7652-433c-a2ba-c0c34554ce4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2d4680-7652-433c-a2ba-c0c34554ce4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-637719723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe5262b0-e92a-4ab8-8e51-fa37ddee33f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f9b0486fff4875aa0ca84bf787ceaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:22:40Z,use_quota=True,user_id='9b36b133527a4056ae9644ba31eb568c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf5ec21-577e-43e3-b7ef-e9e149de7423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf5ec21-577e-43e3-b7ef-e9e149de7423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced5de90-6ec4-49d1-bf54-ff8fbe6e7d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced5de90-6ec4-49d1-bf54-ff8fbe6e7d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe5262b0-e92a-4ab8-8e51-fa37ddee33f1', 'volume_name': 'volume-fe5262b0-e92a-4ab8-8e51-fa37ddee33f1', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f68a60-d789-4b92-a305-2b1f3da80516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f68a60-d789-4b92-a305-2b1f3da80516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d472ba-a767-4ffa-9bf0-83220463ce4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:39 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Volume fe5262b0-e92a-4ab8-8e51-fa37ddee33f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe5262b0-e92a-4ab8-8e51-fa37ddee33f1', 'volume_size': 1}
Jul 03 13:22:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:22:40 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-abe6c3af-4636-47a2-9b4e-f2e479b9ed54 1073741824" returned: 0 in 0.997s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-abe6c3af-4636-47a2-9b4e-f2e479b9ed54 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:40 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:22:40 devstack sudo[106259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-abe6c3af-4636-47a2-9b4e-f2e479b9ed54
Jul 03 13:22:40 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:40 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Flow 'volume_create_manager' (6f1d9119-bd42-48a9-a1f7-e6d196495bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:22:40 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31fb02e0-d0fa-413d-8d91-535befee919b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:40 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31fb02e0-d0fa-413d-8d91-535befee919b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-930619063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650fec33-7f8f-44f7-b52d-98e28f87f06f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f9b0486fff4875aa0ca84bf787ceaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:22:40Z,use_quota=True,user_id='9b36b133527a4056ae9644ba31eb568c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:40 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a831d24-7b26-4b72-a528-bf4bfcfd797f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:40 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a831d24-7b26-4b72-a528-bf4bfcfd797f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:40 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da32226-9ba6-4a24-975a-7bc95eb3a8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:40 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da32226-9ba6-4a24-975a-7bc95eb3a8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '650fec33-7f8f-44f7-b52d-98e28f87f06f', 'volume_name': 'volume-650fec33-7f8f-44f7-b52d-98e28f87f06f', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:40 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d417f4-8caf-4d13-aeb1-9f17cf42db8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:40 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d417f4-8caf-4d13-aeb1-9f17cf42db8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:40 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (267e8cab-1917-43d6-8c62-988e2d5eafcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:40 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Volume 650fec33-7f8f-44f7-b52d-98e28f87f06f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-650fec33-7f8f-44f7-b52d-98e28f87f06f', 'volume_size': 1}
Jul 03 13:22:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:22:40 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:22:40 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Flow 'volume_create_manager' (08168eb0-dedc-4f80-b074-f18a8d725194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:22:40 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (960a0a49-9e5b-4aa3-bd60-edfbdd7f29b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:40 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (960a0a49-9e5b-4aa3-bd60-edfbdd7f29b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-215857284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a33983-4344-42f8-aa37-5fa6eeba92b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f9b0486fff4875aa0ca84bf787ceaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:22:41Z,use_quota=True,user_id='9b36b133527a4056ae9644ba31eb568c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:40 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab28c8d9-b641-4ebd-b95f-8b3553538dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:40 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab28c8d9-b641-4ebd-b95f-8b3553538dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:40 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1027212a-e917-425f-848f-63696165ec22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:40 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1027212a-e917-425f-848f-63696165ec22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1a33983-4344-42f8-aa37-5fa6eeba92b5', 'volume_name': 'volume-e1a33983-4344-42f8-aa37-5fa6eeba92b5', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:40 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6c558b3-f116-4804-b170-1eb6d1859c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:40 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6c558b3-f116-4804-b170-1eb6d1859c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:40 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72c1fab-667b-4fd1-850a-c90d68515621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:40 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Volume e1a33983-4344-42f8-aa37-5fa6eeba92b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1a33983-4344-42f8-aa37-5fa6eeba92b5', 'volume_size': 1}
Jul 03 13:22:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:22:41 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-abe6c3af-4636-47a2-9b4e-f2e479b9ed54" returned: 0 in 0.734s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:22:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:22:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.403s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:22:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-301628883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d3bd4ca-018a-4531-8c4e-c30ab964e0a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f9b0486fff4875aa0ca84bf787ceaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:22:39Z,use_quota=True,user_id='9b36b133527a4056ae9644ba31eb568c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:22:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Creating volume 4d3bd4ca-018a-4531-8c4e-c30ab964e0a9 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:22:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:22:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:22:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:22:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:22:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:22:41 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:22:41 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:22:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4d3bd4ca-018a-4531-8c4e-c30ab964e0a9 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:41 devstack sudo[106262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4d3bd4ca-018a-4531-8c4e-c30ab964e0a9 1073741824
Jul 03 13:22:41 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269a37ec-5699-427c-920c-c2a5a2ca70f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abe6c3af-4636-47a2-9b4e-f2e479b9ed54', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a3f36b6-4e3e-4641-b82d-3439a9660813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:41 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Volume volume-abe6c3af-4636-47a2-9b4e-f2e479b9ed54 (abe6c3af-4636-47a2-9b4e-f2e479b9ed54): created successfully
Jul 03 13:22:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a3f36b6-4e3e-4641-b82d-3439a9660813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:41 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Flow 'volume_create_manager' (f1364dbd-162f-4d0b-a47d-72089a2849ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:22:41 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-4658d81f-a588-41c0-a5b9-8d1b9e547092 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Created volume successfully.
Jul 03 13:22:41 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4d3bd4ca-018a-4531-8c4e-c30ab964e0a9 1073741824" returned: 0 in 0.896s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4d3bd4ca-018a-4531-8c4e-c30ab964e0a9 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:41 devstack sudo[106267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4d3bd4ca-018a-4531-8c4e-c30ab964e0a9
Jul 03 13:22:41 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:42 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4d3bd4ca-018a-4531-8c4e-c30ab964e0a9" returned: 0 in 0.663s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:42 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:22:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:22:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.632s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:22:42 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-637719723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe5262b0-e92a-4ab8-8e51-fa37ddee33f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f9b0486fff4875aa0ca84bf787ceaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:22:40Z,use_quota=True,user_id='9b36b133527a4056ae9644ba31eb568c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:22:42 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Creating volume fe5262b0-e92a-4ab8-8e51-fa37ddee33f1 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:22:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:22:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:22:42 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:22:42 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:22:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:22:42 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:22:42 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:22:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fe5262b0-e92a-4ab8-8e51-fa37ddee33f1 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:42 devstack sudo[106270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fe5262b0-e92a-4ab8-8e51-fa37ddee33f1 1073741824
Jul 03 13:22:42 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:42 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (252de7f6-862e-4a20-836e-2ff7ac1544b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d3bd4ca-018a-4531-8c4e-c30ab964e0a9', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:42 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d506871-aee3-4488-bba1-fe081ed009ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:42 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Volume volume-4d3bd4ca-018a-4531-8c4e-c30ab964e0a9 (4d3bd4ca-018a-4531-8c4e-c30ab964e0a9): created successfully
Jul 03 13:22:42 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d506871-aee3-4488-bba1-fe081ed009ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:42 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Flow 'volume_create_manager' (c9be342d-cbbd-4bef-b4c7-414564599243) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:22:42 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-4abb2703-83bc-474c-9677-505934c5533e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Created volume successfully.
Jul 03 13:22:43 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fe5262b0-e92a-4ab8-8e51-fa37ddee33f1 1073741824" returned: 0 in 0.831s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fe5262b0-e92a-4ab8-8e51-fa37ddee33f1 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:43 devstack sudo[106276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fe5262b0-e92a-4ab8-8e51-fa37ddee33f1
Jul 03 13:22:43 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:44 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fe5262b0-e92a-4ab8-8e51-fa37ddee33f1" returned: 0 in 0.699s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:22:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:22:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.817s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:22:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-930619063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650fec33-7f8f-44f7-b52d-98e28f87f06f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f9b0486fff4875aa0ca84bf787ceaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:22:40Z,use_quota=True,user_id='9b36b133527a4056ae9644ba31eb568c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:22:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Creating volume 650fec33-7f8f-44f7-b52d-98e28f87f06f {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:22:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:22:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:22:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:22:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:22:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:22:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:22:44 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:22:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-650fec33-7f8f-44f7-b52d-98e28f87f06f 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d472ba-a767-4ffa-9bf0-83220463ce4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe5262b0-e92a-4ab8-8e51-fa37ddee33f1', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:44 devstack sudo[106279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-650fec33-7f8f-44f7-b52d-98e28f87f06f 1073741824
Jul 03 13:22:44 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2284c7b6-4151-4d08-b409-50c5b8fedf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:44 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Volume volume-fe5262b0-e92a-4ab8-8e51-fa37ddee33f1 (fe5262b0-e92a-4ab8-8e51-fa37ddee33f1): created successfully
Jul 03 13:22:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2284c7b6-4151-4d08-b409-50c5b8fedf37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Flow 'volume_create_manager' (ceff8cf2-3b8c-4f7c-996d-fbb40449e7ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:22:44 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-9b363f85-9972-4f8c-bba4-d29c2cb97a6e tempest-CreateVolumesFromSnapshotTest-1073898006 None] Created volume successfully.
Jul 03 13:22:45 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-650fec33-7f8f-44f7-b52d-98e28f87f06f 1073741824" returned: 0 in 0.869s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-650fec33-7f8f-44f7-b52d-98e28f87f06f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:45 devstack sudo[106284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-650fec33-7f8f-44f7-b52d-98e28f87f06f
Jul 03 13:22:45 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:45 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-650fec33-7f8f-44f7-b52d-98e28f87f06f" returned: 0 in 0.635s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:45 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:22:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:22:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.996s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:22:45 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-215857284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a33983-4344-42f8-aa37-5fa6eeba92b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f9b0486fff4875aa0ca84bf787ceaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:22:41Z,use_quota=True,user_id='9b36b133527a4056ae9644ba31eb568c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:22:45 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Creating volume e1a33983-4344-42f8-aa37-5fa6eeba92b5 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:22:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:22:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:22:45 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:22:45 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:22:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:22:45 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:22:45 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:22:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a33983-4344-42f8-aa37-5fa6eeba92b5 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:45 devstack sudo[106287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a33983-4344-42f8-aa37-5fa6eeba92b5 1073741824
Jul 03 13:22:45 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (267e8cab-1917-43d6-8c62-988e2d5eafcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-650fec33-7f8f-44f7-b52d-98e28f87f06f', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:45 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:45 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec79a2b6-4e72-44d5-999c-1d45dcd3725f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:45 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Volume volume-650fec33-7f8f-44f7-b52d-98e28f87f06f (650fec33-7f8f-44f7-b52d-98e28f87f06f): created successfully
Jul 03 13:22:45 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec79a2b6-4e72-44d5-999c-1d45dcd3725f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:45 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Flow 'volume_create_manager' (6f1d9119-bd42-48a9-a1f7-e6d196495bdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:22:45 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-d73a00d0-e8e9-40ec-bce1-b1dc7156a835 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Created volume successfully.
Jul 03 13:22:46 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a33983-4344-42f8-aa37-5fa6eeba92b5 1073741824" returned: 0 in 0.859s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a33983-4344-42f8-aa37-5fa6eeba92b5 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:46 devstack sudo[106293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a33983-4344-42f8-aa37-5fa6eeba92b5
Jul 03 13:22:46 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:47 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a33983-4344-42f8-aa37-5fa6eeba92b5" returned: 0 in 0.707s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:47 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:22:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:22:47 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72c1fab-667b-4fd1-850a-c90d68515621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1a33983-4344-42f8-aa37-5fa6eeba92b5', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:47 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbe65ef-e89a-4bd8-9021-f4575a246e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:22:47 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Volume volume-e1a33983-4344-42f8-aa37-5fa6eeba92b5 (e1a33983-4344-42f8-aa37-5fa6eeba92b5): created successfully
Jul 03 13:22:47 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbe65ef-e89a-4bd8-9021-f4575a246e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:22:47 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Flow 'volume_create_manager' (08168eb0-dedc-4f80-b074-f18a8d725194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:22:47 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-e9933895-898d-4dcc-902d-525439292936 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Created volume successfully.
Jul 03 13:22:48 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7587ffb7-fe18-4d2e-877b-c7c367f83db3 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "cinder-e1a33983-4344-42f8-aa37-5fa6eeba92b5-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:22:48 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7587ffb7-fe18-4d2e-877b-c7c367f83db3 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-e1a33983-4344-42f8-aa37-5fa6eeba92b5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:22:48 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7587ffb7-fe18-4d2e-877b-c7c367f83db3 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "cinder-quobyte-e1a33983-4344-42f8-aa37-5fa6eeba92b5" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:22:48 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7587ffb7-fe18-4d2e-877b-c7c367f83db3 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-quobyte-e1a33983-4344-42f8-aa37-5fa6eeba92b5" acquired by "delete_volume" :: waited 0.015s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:22:48 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fdae56-cb6d-4806-9812-f5cae31edf57]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:22:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7587ffb7-fe18-4d2e-877b-c7c367f83db3 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a33983-4344-42f8-aa37-5fa6eeba92b5 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:48 devstack sudo[106298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a33983-4344-42f8-aa37-5fa6eeba92b5
Jul 03 13:22:48 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:49 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7587ffb7-fe18-4d2e-877b-c7c367f83db3 tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a33983-4344-42f8-aa37-5fa6eeba92b5" returned: 0 in 0.778s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7587ffb7-fe18-4d2e-877b-c7c367f83db3 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a33983-4344-42f8-aa37-5fa6eeba92b5 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:49 devstack sudo[106303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a33983-4344-42f8-aa37-5fa6eeba92b5
Jul 03 13:22:49 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:49 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7587ffb7-fe18-4d2e-877b-c7c367f83db3 tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a33983-4344-42f8-aa37-5fa6eeba92b5" returned: 0 in 0.658s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7587ffb7-fe18-4d2e-877b-c7c367f83db3 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-quobyte-e1a33983-4344-42f8-aa37-5fa6eeba92b5" released by "delete_volume" :: held 1.476s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:22:49 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-7587ffb7-fe18-4d2e-877b-c7c367f83db3 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Created reservations ['c9e47cfa-7a40-406c-a00d-08b4e2d7a4a7', '78c3674a-9c89-4972-8db9-690034eb39a1', '49d4e2ce-048b-43f4-b29c-2ae28f49079e', '4472a647-7970-4062-a97f-ea606bd8c19e'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:22:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-7587ffb7-fe18-4d2e-877b-c7c367f83db3 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:22:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-7587ffb7-fe18-4d2e-877b-c7c367f83db3 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:22:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-7587ffb7-fe18-4d2e-877b-c7c367f83db3 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:22:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-7587ffb7-fe18-4d2e-877b-c7c367f83db3 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:22:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-7587ffb7-fe18-4d2e-877b-c7c367f83db3 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:22:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7587ffb7-fe18-4d2e-877b-c7c367f83db3 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:49 devstack sudo[106306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:22:49 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b7cb411a-3346-40d4-8861-24796538c6b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "cinder-650fec33-7f8f-44f7-b52d-98e28f87f06f-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:22:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b7cb411a-3346-40d4-8861-24796538c6b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-650fec33-7f8f-44f7-b52d-98e28f87f06f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:22:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b7cb411a-3346-40d4-8861-24796538c6b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "cinder-quobyte-650fec33-7f8f-44f7-b52d-98e28f87f06f" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:22:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b7cb411a-3346-40d4-8861-24796538c6b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-quobyte-650fec33-7f8f-44f7-b52d-98e28f87f06f" acquired by "delete_volume" :: waited 0.015s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:22:50 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7587ffb7-fe18-4d2e-877b-c7c367f83db3 tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.690s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:50 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-7587ffb7-fe18-4d2e-877b-c7c367f83db3 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:22:50 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-7587ffb7-fe18-4d2e-877b-c7c367f83db3 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Deleted volume successfully.
Jul 03 13:22:50 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbd4162-ad4d-4219-930a-d74ffa6c74c0]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:22:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b7cb411a-3346-40d4-8861-24796538c6b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-650fec33-7f8f-44f7-b52d-98e28f87f06f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7587ffb7-fe18-4d2e-877b-c7c367f83db3 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-e1a33983-4344-42f8-aa37-5fa6eeba92b5-delete_volume" released by "delete_volume" :: held 2.366s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:22:50 devstack sudo[106309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-650fec33-7f8f-44f7-b52d-98e28f87f06f
Jul 03 13:22:50 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:51 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b7cb411a-3346-40d4-8861-24796538c6b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-650fec33-7f8f-44f7-b52d-98e28f87f06f" returned: 0 in 0.748s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b7cb411a-3346-40d4-8861-24796538c6b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-650fec33-7f8f-44f7-b52d-98e28f87f06f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:51 devstack sudo[106314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-650fec33-7f8f-44f7-b52d-98e28f87f06f
Jul 03 13:22:51 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:52 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b7cb411a-3346-40d4-8861-24796538c6b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-650fec33-7f8f-44f7-b52d-98e28f87f06f" returned: 0 in 0.637s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:52 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b7cb411a-3346-40d4-8861-24796538c6b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-quobyte-650fec33-7f8f-44f7-b52d-98e28f87f06f" released by "delete_volume" :: held 1.431s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:22:52 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-b7cb411a-3346-40d4-8861-24796538c6b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Created reservations ['5551a93e-a316-40c7-b26c-5f069c23d887', 'c42a0717-ece2-4971-a962-8fdd1e4ed48d', 'd5e446e7-1201-4a68-864b-4eae5b6fde86', '2ec3f27d-a6b1-4cbd-af7c-02e887890f2a'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:22:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b7cb411a-3346-40d4-8861-24796538c6b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:22:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b7cb411a-3346-40d4-8861-24796538c6b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:22:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b7cb411a-3346-40d4-8861-24796538c6b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:22:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b7cb411a-3346-40d4-8861-24796538c6b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:22:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b7cb411a-3346-40d4-8861-24796538c6b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:22:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b7cb411a-3346-40d4-8861-24796538c6b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:52 devstack sudo[106317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:22:52 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:52 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1b130071-a1f3-471e-860d-94bf4dac552c tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "cinder-fe5262b0-e92a-4ab8-8e51-fa37ddee33f1-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:22:52 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1b130071-a1f3-471e-860d-94bf4dac552c tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-fe5262b0-e92a-4ab8-8e51-fa37ddee33f1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:22:52 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1b130071-a1f3-471e-860d-94bf4dac552c tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "cinder-quobyte-fe5262b0-e92a-4ab8-8e51-fa37ddee33f1" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:22:52 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1b130071-a1f3-471e-860d-94bf4dac552c tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-quobyte-fe5262b0-e92a-4ab8-8e51-fa37ddee33f1" acquired by "delete_volume" :: waited 0.030s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:22:52 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef5c85c-7b56-41fc-8c70-dc7df8e7302a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:22:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1b130071-a1f3-471e-860d-94bf4dac552c tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fe5262b0-e92a-4ab8-8e51-fa37ddee33f1 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:52 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b7cb411a-3346-40d4-8861-24796538c6b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.769s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:52 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-b7cb411a-3346-40d4-8861-24796538c6b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:22:52 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-b7cb411a-3346-40d4-8861-24796538c6b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Deleted volume successfully.
Jul 03 13:22:53 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b7cb411a-3346-40d4-8861-24796538c6b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-650fec33-7f8f-44f7-b52d-98e28f87f06f-delete_volume" released by "delete_volume" :: held 2.430s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:22:53 devstack sudo[106320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fe5262b0-e92a-4ab8-8e51-fa37ddee33f1
Jul 03 13:22:53 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:53 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1b130071-a1f3-471e-860d-94bf4dac552c tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fe5262b0-e92a-4ab8-8e51-fa37ddee33f1" returned: 0 in 0.780s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1b130071-a1f3-471e-860d-94bf4dac552c tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fe5262b0-e92a-4ab8-8e51-fa37ddee33f1 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:53 devstack sudo[106326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fe5262b0-e92a-4ab8-8e51-fa37ddee33f1
Jul 03 13:22:53 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:54 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1b130071-a1f3-471e-860d-94bf4dac552c tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-fe5262b0-e92a-4ab8-8e51-fa37ddee33f1" returned: 0 in 0.648s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:54 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1b130071-a1f3-471e-860d-94bf4dac552c tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-quobyte-fe5262b0-e92a-4ab8-8e51-fa37ddee33f1" released by "delete_volume" :: held 1.473s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:22:54 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-1b130071-a1f3-471e-860d-94bf4dac552c tempest-CreateVolumesFromSnapshotTest-1073898006 None] Created reservations ['654d8452-bd20-43ae-a09c-2c1dd6b566d8', 'cfa2e20b-c6a6-4e85-a6b7-f4ff982f6810', 'bc0fbeec-db0f-473d-9210-28744960e119', '80c45e03-16d9-4a05-802c-4cf413e80da3'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:22:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1b130071-a1f3-471e-860d-94bf4dac552c tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:22:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1b130071-a1f3-471e-860d-94bf4dac552c tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:22:54 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1b130071-a1f3-471e-860d-94bf4dac552c tempest-CreateVolumesFromSnapshotTest-1073898006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:22:54 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1b130071-a1f3-471e-860d-94bf4dac552c tempest-CreateVolumesFromSnapshotTest-1073898006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:22:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1b130071-a1f3-471e-860d-94bf4dac552c tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:22:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1b130071-a1f3-471e-860d-94bf4dac552c tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:54 devstack sudo[106329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:22:54 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3635b74e-00aa-451b-a9dc-0f749c6959b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "cinder-4d3bd4ca-018a-4531-8c4e-c30ab964e0a9-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:22:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3635b74e-00aa-451b-a9dc-0f749c6959b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-4d3bd4ca-018a-4531-8c4e-c30ab964e0a9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:22:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3635b74e-00aa-451b-a9dc-0f749c6959b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "cinder-quobyte-4d3bd4ca-018a-4531-8c4e-c30ab964e0a9" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:22:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3635b74e-00aa-451b-a9dc-0f749c6959b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-quobyte-4d3bd4ca-018a-4531-8c4e-c30ab964e0a9" acquired by "delete_volume" :: waited 0.023s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:22:55 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2846a3d-784a-477f-ba94-6db0a9c6597b]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:22:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3635b74e-00aa-451b-a9dc-0f749c6959b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4d3bd4ca-018a-4531-8c4e-c30ab964e0a9 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:55 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1b130071-a1f3-471e-860d-94bf4dac552c tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.717s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:55 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-1b130071-a1f3-471e-860d-94bf4dac552c tempest-CreateVolumesFromSnapshotTest-1073898006 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:22:55 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-1b130071-a1f3-471e-860d-94bf4dac552c tempest-CreateVolumesFromSnapshotTest-1073898006 None] Deleted volume successfully.
Jul 03 13:22:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1b130071-a1f3-471e-860d-94bf4dac552c tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-fe5262b0-e92a-4ab8-8e51-fa37ddee33f1-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:22:55 devstack sudo[106332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4d3bd4ca-018a-4531-8c4e-c30ab964e0a9
Jul 03 13:22:55 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:56 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3635b74e-00aa-451b-a9dc-0f749c6959b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4d3bd4ca-018a-4531-8c4e-c30ab964e0a9" returned: 0 in 0.821s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3635b74e-00aa-451b-a9dc-0f749c6959b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4d3bd4ca-018a-4531-8c4e-c30ab964e0a9 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:56 devstack sudo[106338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4d3bd4ca-018a-4531-8c4e-c30ab964e0a9
Jul 03 13:22:56 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:56 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3635b74e-00aa-451b-a9dc-0f749c6959b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4d3bd4ca-018a-4531-8c4e-c30ab964e0a9" returned: 0 in 0.655s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:56 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3635b74e-00aa-451b-a9dc-0f749c6959b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-quobyte-4d3bd4ca-018a-4531-8c4e-c30ab964e0a9" released by "delete_volume" :: held 1.536s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:22:56 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-3635b74e-00aa-451b-a9dc-0f749c6959b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Created reservations ['ff3ec996-8720-42b5-b2b8-0c83b09035b9', '29272b39-8549-4aab-bf08-7310cb216673', '631241e7-dcef-4be8-8f18-e3772c61a1a3', '4d000eaf-d98a-495c-bc4c-bdea91f5bee9'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:22:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3635b74e-00aa-451b-a9dc-0f749c6959b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:22:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3635b74e-00aa-451b-a9dc-0f749c6959b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:22:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3635b74e-00aa-451b-a9dc-0f749c6959b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:22:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3635b74e-00aa-451b-a9dc-0f749c6959b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:22:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3635b74e-00aa-451b-a9dc-0f749c6959b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:22:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3635b74e-00aa-451b-a9dc-0f749c6959b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:56 devstack sudo[106341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:22:56 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6d259b01-6b64-4e7c-8cd9-ee9ffec2a628 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "cinder-abe6c3af-4636-47a2-9b4e-f2e479b9ed54-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:22:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6d259b01-6b64-4e7c-8cd9-ee9ffec2a628 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-abe6c3af-4636-47a2-9b4e-f2e479b9ed54-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:22:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6d259b01-6b64-4e7c-8cd9-ee9ffec2a628 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "cinder-quobyte-abe6c3af-4636-47a2-9b4e-f2e479b9ed54" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:22:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6d259b01-6b64-4e7c-8cd9-ee9ffec2a628 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-quobyte-abe6c3af-4636-47a2-9b4e-f2e479b9ed54" acquired by "delete_volume" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:22:57 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[296f0d75-a900-4b76-9fbd-a7acde7ee7a9]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:22:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6d259b01-6b64-4e7c-8cd9-ee9ffec2a628 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-abe6c3af-4636-47a2-9b4e-f2e479b9ed54 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:57 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3635b74e-00aa-451b-a9dc-0f749c6959b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.670s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:57 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-3635b74e-00aa-451b-a9dc-0f749c6959b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:22:57 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-3635b74e-00aa-451b-a9dc-0f749c6959b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Deleted volume successfully.
Jul 03 13:22:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3635b74e-00aa-451b-a9dc-0f749c6959b8 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-4d3bd4ca-018a-4531-8c4e-c30ab964e0a9-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:22:57 devstack sudo[106344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-abe6c3af-4636-47a2-9b4e-f2e479b9ed54
Jul 03 13:22:57 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:58 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6d259b01-6b64-4e7c-8cd9-ee9ffec2a628 tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-abe6c3af-4636-47a2-9b4e-f2e479b9ed54" returned: 0 in 0.779s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6d259b01-6b64-4e7c-8cd9-ee9ffec2a628 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-abe6c3af-4636-47a2-9b4e-f2e479b9ed54 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:58 devstack sudo[106350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-abe6c3af-4636-47a2-9b4e-f2e479b9ed54
Jul 03 13:22:58 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:58 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6d259b01-6b64-4e7c-8cd9-ee9ffec2a628 tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-abe6c3af-4636-47a2-9b4e-f2e479b9ed54" returned: 0 in 0.650s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:58 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6d259b01-6b64-4e7c-8cd9-ee9ffec2a628 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-quobyte-abe6c3af-4636-47a2-9b4e-f2e479b9ed54" released by "delete_volume" :: held 1.473s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:22:58 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-6d259b01-6b64-4e7c-8cd9-ee9ffec2a628 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Created reservations ['b73439a8-2d2c-4c77-8549-cf1ffefac623', '75b34984-b549-4c4c-97cf-740632d8c715', 'cde90c66-d7f1-491f-bd16-fc41fcc4769d', '7c4c84eb-3f0e-4f46-9e57-189e6619bfb9'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:22:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6d259b01-6b64-4e7c-8cd9-ee9ffec2a628 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:22:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6d259b01-6b64-4e7c-8cd9-ee9ffec2a628 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:22:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6d259b01-6b64-4e7c-8cd9-ee9ffec2a628 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:22:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6d259b01-6b64-4e7c-8cd9-ee9ffec2a628 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:22:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6d259b01-6b64-4e7c-8cd9-ee9ffec2a628 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:22:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6d259b01-6b64-4e7c-8cd9-ee9ffec2a628 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:59 devstack sudo[106353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:22:59 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:22:59 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f8e8a58d-6afe-4f90-aade-3d56fb57a017 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "cinder-3ab2ce5f-2be8-4f31-911a-e2fd21293c37-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:22:59 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f8e8a58d-6afe-4f90-aade-3d56fb57a017 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-3ab2ce5f-2be8-4f31-911a-e2fd21293c37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:22:59 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f8e8a58d-6afe-4f90-aade-3d56fb57a017 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "cinder-quobyte-28cc267f-1e4e-49ec-ba04-30c7f7666d65" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:22:59 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f8e8a58d-6afe-4f90-aade-3d56fb57a017 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-quobyte-28cc267f-1e4e-49ec-ba04-30c7f7666d65" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:22:59 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f8e8a58d-6afe-4f90-aade-3d56fb57a017 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "cinder-quobyte-3ab2ce5f-2be8-4f31-911a-e2fd21293c37" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:22:59 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f8e8a58d-6afe-4f90-aade-3d56fb57a017 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-quobyte-3ab2ce5f-2be8-4f31-911a-e2fd21293c37" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:22:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-f8e8a58d-6afe-4f90-aade-3d56fb57a017 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Deleting offline snapshot 3ab2ce5f-2be8-4f31-911a-e2fd21293c37 of volume 28cc267f-1e4e-49ec-ba04-30c7f7666d65 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:22:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-f8e8a58d-6afe-4f90-aade-3d56fb57a017 tempest-CreateVolumesFromSnapshotTest-1073898006 None] snapshot_file for this snap is: volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65.3ab2ce5f-2be8-4f31-911a-e2fd21293c37 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:22:59 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90684ee-34df-4abf-b055-0b8de5692f04]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:22:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f8e8a58d-6afe-4f90-aade-3d56fb57a017 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65.3ab2ce5f-2be8-4f31-911a-e2fd21293c37 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:22:59 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root
Jul 03 13:22:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6d259b01-6b64-4e7c-8cd9-ee9ffec2a628 tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.659s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:22:59 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-6d259b01-6b64-4e7c-8cd9-ee9ffec2a628 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:22:59 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-6d259b01-6b64-4e7c-8cd9-ee9ffec2a628 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Deleted volume successfully.
Jul 03 13:22:59 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6d259b01-6b64-4e7c-8cd9-ee9ffec2a628 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-abe6c3af-4636-47a2-9b4e-f2e479b9ed54-delete_volume" released by "delete_volume" :: held 2.355s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:22:59 devstack sudo[106356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65.3ab2ce5f-2be8-4f31-911a-e2fd21293c37
Jul 03 13:22:59 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:00 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f8e8a58d-6afe-4f90-aade-3d56fb57a017 tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65.3ab2ce5f-2be8-4f31-911a-e2fd21293c37" returned: 0 in 0.803s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-f8e8a58d-6afe-4f90-aade-3d56fb57a017 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:23:00 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3eb53f4-0746-4a12-94a9-5ad1805f3224]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:23:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f8e8a58d-6afe-4f90-aade-3d56fb57a017 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:00 devstack sudo[106363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65
Jul 03 13:23:00 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:01 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f8e8a58d-6afe-4f90-aade-3d56fb57a017 tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65" returned: 0 in 0.802s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f8e8a58d-6afe-4f90-aade-3d56fb57a017 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65.3ab2ce5f-2be8-4f31-911a-e2fd21293c37 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:01 devstack sudo[106368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65.3ab2ce5f-2be8-4f31-911a-e2fd21293c37
Jul 03 13:23:01 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:02 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f8e8a58d-6afe-4f90-aade-3d56fb57a017 tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65.3ab2ce5f-2be8-4f31-911a-e2fd21293c37" returned: 0 in 0.773s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f8e8a58d-6afe-4f90-aade-3d56fb57a017 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65.3ab2ce5f-2be8-4f31-911a-e2fd21293c37 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:02 devstack sudo[106373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65.3ab2ce5f-2be8-4f31-911a-e2fd21293c37
Jul 03 13:23:02 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:02 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f8e8a58d-6afe-4f90-aade-3d56fb57a017 tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65.3ab2ce5f-2be8-4f31-911a-e2fd21293c37" returned: 0 in 0.642s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:02 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f8e8a58d-6afe-4f90-aade-3d56fb57a017 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-quobyte-3ab2ce5f-2be8-4f31-911a-e2fd21293c37" released by "_delete_snapshot" :: held 3.142s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:23:02 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f8e8a58d-6afe-4f90-aade-3d56fb57a017 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-quobyte-28cc267f-1e4e-49ec-ba04-30c7f7666d65" released by "delete_snapshot" :: held 3.165s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:23:03 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-f8e8a58d-6afe-4f90-aade-3d56fb57a017 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Created reservations ['b58a8815-7c07-4c28-975f-5733136d3f06', '23d1acdb-8b8a-4f22-a21e-7cbdf5fd5ce8', '9f45b6e4-b417-4d6a-b3da-834001aa2381', 'c7249b39-fdb1-4f8c-a696-1f37901ed97e'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:23:05 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-f8e8a58d-6afe-4f90-aade-3d56fb57a017 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Delete snapshot completed successfully.
Jul 03 13:23:05 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f8e8a58d-6afe-4f90-aade-3d56fb57a017 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-3ab2ce5f-2be8-4f31-911a-e2fd21293c37-delete_snapshot" released by "delete_snapshot" :: held 6.307s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:23:06 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-db1857b8-4c4c-4d71-9b46-6f1fc0f58894 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "cinder-28cc267f-1e4e-49ec-ba04-30c7f7666d65-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:23:06 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-db1857b8-4c4c-4d71-9b46-6f1fc0f58894 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-28cc267f-1e4e-49ec-ba04-30c7f7666d65-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:23:06 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-db1857b8-4c4c-4d71-9b46-6f1fc0f58894 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "cinder-quobyte-28cc267f-1e4e-49ec-ba04-30c7f7666d65" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:23:06 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-db1857b8-4c4c-4d71-9b46-6f1fc0f58894 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-quobyte-28cc267f-1e4e-49ec-ba04-30c7f7666d65" acquired by "delete_volume" :: waited 0.020s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:23:07 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c02a6f4-bc64-416c-871e-7cc5cc8ce5dc]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:23:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-db1857b8-4c4c-4d71-9b46-6f1fc0f58894 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:07 devstack sudo[106379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65
Jul 03 13:23:07 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:07 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-db1857b8-4c4c-4d71-9b46-6f1fc0f58894 tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65" returned: 0 in 0.741s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-db1857b8-4c4c-4d71-9b46-6f1fc0f58894 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:07 devstack sudo[106384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65
Jul 03 13:23:07 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:08 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-db1857b8-4c4c-4d71-9b46-6f1fc0f58894 tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-28cc267f-1e4e-49ec-ba04-30c7f7666d65" returned: 0 in 0.638s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-db1857b8-4c4c-4d71-9b46-6f1fc0f58894 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-quobyte-28cc267f-1e4e-49ec-ba04-30c7f7666d65" released by "delete_volume" :: held 1.443s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:23:08 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-db1857b8-4c4c-4d71-9b46-6f1fc0f58894 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Created reservations ['88e742fd-3760-4a63-8597-ba0273b3b9cd', '3e65ab0e-f3aa-4190-84b2-747134459dc3', 'ea2bf726-36fc-47bf-9807-5c69fa833e55', '52453d19-7f5a-4201-8b69-4c434b541e98'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:23:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-db1857b8-4c4c-4d71-9b46-6f1fc0f58894 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-db1857b8-4c4c-4d71-9b46-6f1fc0f58894 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-db1857b8-4c4c-4d71-9b46-6f1fc0f58894 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:23:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-db1857b8-4c4c-4d71-9b46-6f1fc0f58894 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:23:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-db1857b8-4c4c-4d71-9b46-6f1fc0f58894 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-db1857b8-4c4c-4d71-9b46-6f1fc0f58894 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:08 devstack sudo[106387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:23:08 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:09 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-db1857b8-4c4c-4d71-9b46-6f1fc0f58894 tempest-CreateVolumesFromSnapshotTest-1073898006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.659s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:09 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-db1857b8-4c4c-4d71-9b46-6f1fc0f58894 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:23:09 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-db1857b8-4c4c-4d71-9b46-6f1fc0f58894 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Deleted volume successfully.
Jul 03 13:23:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-db1857b8-4c4c-4d71-9b46-6f1fc0f58894 tempest-CreateVolumesFromSnapshotTest-1073898006 None] Lock "cinder-28cc267f-1e4e-49ec-ba04-30c7f7666d65-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:23:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:23:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:23:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:23:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:15 devstack sudo[106417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:23:15 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:15 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.665s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:15 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:23:15 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:23:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 28 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:23:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>, <Thread(tpool_thread_0, started daemon 134850092431040)>, <Thread(tpool_thread_1, started daemon 134850084021952)>, <Thread(tpool_thread_2, started daemon 134850075612864)>, <Thread(tpool_thread_3, started daemon 134850067203776)>, <Thread(tpool_thread_4, started daemon 134850058794688)>, <Thread(tpool_thread_5, started daemon 134850050385600)>, <Thread(tpool_thread_6, started daemon 134850041976512)>, <Thread(tpool_thread_7, started daemon 134850033567424)>, <Thread(tpool_thread_8, started daemon 134850025158336)>, <Thread(tpool_thread_9, started daemon 134850016749248)>, <Thread(tpool_thread_10, started daemon 134850008340160)>, <Thread(tpool_thread_11, started daemon 134849999931072)>, <Thread(tpool_thread_12, started daemon 134849991521984)>, <Thread(tpool_thread_13, started daemon 134849983112896)>, <Thread(tpool_thread_14, started daemon 134849974703808)>, <Thread(tpool_thread_15, started daemon 134849966294720)>, <Thread(tpool_thread_16, started daemon 134849957885632)>, <Thread(tpool_thread_17, started daemon 134849949476544)>, <Thread(tpool_thread_18, started daemon 134849941067456)>, <Thread(tpool_thread_19, started daemon 134849932658368)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:23:18 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=48,cinder:UPDATE=79,cinder:DELETE=6,cinder:INSERT=14 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:23:19 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:UPDATE=68,cinder:SELECT=55,cinder:INSERT=21,cinder:DELETE=7 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Flow 'volume_create_manager' (969eac67-065c-4ff0-9e01-0e72e11be3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a0a28b5-add6-4ffe-b6a3-c60769a7015a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a0a28b5-add6-4ffe-b6a3-c60769a7015a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1275059925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ceaf9c-1997-42d9-bf88-6754aa61b018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ba6a8217764a49ad82c78678a62bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:23:21Z,use_quota=True,user_id='ef985aa58e414ac5b63e038c9a428733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc82d53-43ed-4635-a62e-b6989e3e4766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc82d53-43ed-4635-a62e-b6989e3e4766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0fef9f7-17f0-4a4c-bf1b-7fcdb22f85a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0fef9f7-17f0-4a4c-bf1b-7fcdb22f85a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7ceaf9c-1997-42d9-bf88-6754aa61b018', 'volume_name': 'volume-d7ceaf9c-1997-42d9-bf88-6754aa61b018', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a318788-0c12-4563-ae1a-fe952a71c356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a318788-0c12-4563-ae1a-fe952a71c356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (191b2576-7cf8-4c9c-b046-36e61b8d7270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:21 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Volume d7ceaf9c-1997-42d9-bf88-6754aa61b018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7ceaf9c-1997-42d9-bf88-6754aa61b018', 'volume_size': 1}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1275059925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ceaf9c-1997-42d9-bf88-6754aa61b018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ba6a8217764a49ad82c78678a62bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:23:21Z,use_quota=True,user_id='ef985aa58e414ac5b63e038c9a428733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Creating volume d7ceaf9c-1997-42d9-bf88-6754aa61b018 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:23:21 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d7ceaf9c-1997-42d9-bf88-6754aa61b018 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:21 devstack sudo[106432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d7ceaf9c-1997-42d9-bf88-6754aa61b018 1073741824
Jul 03 13:23:21 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Flow 'volume_create_manager' (cbf2921b-af6b-4dff-843e-ac4f41cafdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bad5d768-6bf0-4574-a86d-bd520a6695d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bad5d768-6bf0-4574-a86d-bd520a6695d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1692357522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73d8c419-1c30-4a1b-bf4d-3392c55c2522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ba6a8217764a49ad82c78678a62bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:23:22Z,use_quota=True,user_id='ef985aa58e414ac5b63e038c9a428733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec1b9e7-2c91-4564-9a42-533173de6c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec1b9e7-2c91-4564-9a42-533173de6c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a136a7c5-050c-49b9-a070-251ff611bd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a136a7c5-050c-49b9-a070-251ff611bd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73d8c419-1c30-4a1b-bf4d-3392c55c2522', 'volume_name': 'volume-73d8c419-1c30-4a1b-bf4d-3392c55c2522', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (936e979e-fc87-401f-a2ae-da9fe1206011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (936e979e-fc87-401f-a2ae-da9fe1206011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eebe448b-ba3e-420b-89d8-c39cccbda8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:21 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Volume 73d8c419-1c30-4a1b-bf4d-3392c55c2522: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73d8c419-1c30-4a1b-bf4d-3392c55c2522', 'volume_size': 1}
Jul 03 13:23:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:22 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:23:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Flow 'volume_create_manager' (7a7f0e2d-f0fd-4aab-b37d-c7f22d7f4943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:23:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222a112d-c402-4b1f-b4c3-6e0ea223cbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222a112d-c402-4b1f-b4c3-6e0ea223cbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-928747525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce6c7a96-c2c5-444f-9f7d-53bfbc60a76f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ba6a8217764a49ad82c78678a62bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:23:22Z,use_quota=True,user_id='ef985aa58e414ac5b63e038c9a428733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3567316-db9e-4be6-beda-fb1f505a79fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3567316-db9e-4be6-beda-fb1f505a79fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8781ca-8060-442a-8292-cb73e3040fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8781ca-8060-442a-8292-cb73e3040fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce6c7a96-c2c5-444f-9f7d-53bfbc60a76f', 'volume_name': 'volume-ce6c7a96-c2c5-444f-9f7d-53bfbc60a76f', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d27a8a3-5d51-4a80-bd56-270f32790992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d27a8a3-5d51-4a80-bd56-270f32790992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef461c48-c487-4cb8-8d89-91cea868ec08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:22 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Volume ce6c7a96-c2c5-444f-9f7d-53bfbc60a76f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce6c7a96-c2c5-444f-9f7d-53bfbc60a76f', 'volume_size': 1}
Jul 03 13:23:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:22 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d7ceaf9c-1997-42d9-bf88-6754aa61b018 1073741824" returned: 0 in 1.393s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:22 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:23:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Flow 'volume_create_manager' (5c1631af-2050-4809-8e10-390bd91ad918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:23:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd5d031-ccf3-4cb9-aff8-09a495172f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd5d031-ccf3-4cb9-aff8-09a495172f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-858897476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8deadbd6-fe80-4a1a-a12a-7e256f45e36f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ba6a8217764a49ad82c78678a62bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:23:23Z,use_quota=True,user_id='ef985aa58e414ac5b63e038c9a428733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d45c410-e1c5-4da3-bf76-15e0b631a850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d45c410-e1c5-4da3-bf76-15e0b631a850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4e4d6b7-6f7f-49b7-b6b0-a4b628a11932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4e4d6b7-6f7f-49b7-b6b0-a4b628a11932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8deadbd6-fe80-4a1a-a12a-7e256f45e36f', 'volume_name': 'volume-8deadbd6-fe80-4a1a-a12a-7e256f45e36f', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (886ea010-ee5e-45fc-bb74-5a190bc3551c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (886ea010-ee5e-45fc-bb74-5a190bc3551c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5237747c-1319-4478-a0da-010b22e48f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:22 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Volume 8deadbd6-fe80-4a1a-a12a-7e256f45e36f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8deadbd6-fe80-4a1a-a12a-7e256f45e36f', 'volume_size': 1}
Jul 03 13:23:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d7ceaf9c-1997-42d9-bf88-6754aa61b018 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:22 devstack sudo[106439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d7ceaf9c-1997-42d9-bf88-6754aa61b018
Jul 03 13:23:22 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Flow 'volume_create_manager' (324f90dc-f067-40c6-93bf-6e083897cc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d320628-90d9-4ee8-8a2b-138674dc13b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d320628-90d9-4ee8-8a2b-138674dc13b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1609124329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7689ff-a1fd-496b-8c0e-df2e2a19832c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ba6a8217764a49ad82c78678a62bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:23:23Z,use_quota=True,user_id='ef985aa58e414ac5b63e038c9a428733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6d2f2a6-a119-44c9-b695-ddc84fe0aa36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6d2f2a6-a119-44c9-b695-ddc84fe0aa36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1119735-eb06-4eef-8325-3db43b64127b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1119735-eb06-4eef-8325-3db43b64127b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae7689ff-a1fd-496b-8c0e-df2e2a19832c', 'volume_name': 'volume-ae7689ff-a1fd-496b-8c0e-df2e2a19832c', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d92d53b-cac0-4dde-8da1-6a88b3ac2e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d92d53b-cac0-4dde-8da1-6a88b3ac2e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc48f74b-8699-4fc4-8232-59621a0f262e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:23 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Volume ae7689ff-a1fd-496b-8c0e-df2e2a19832c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae7689ff-a1fd-496b-8c0e-df2e2a19832c', 'volume_size': 1}
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:23 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d7ceaf9c-1997-42d9-bf88-6754aa61b018" returned: 0 in 0.745s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] <== create_volume: return (2297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.300s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.786s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1692357522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73d8c419-1c30-4a1b-bf4d-3392c55c2522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ba6a8217764a49ad82c78678a62bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:23:22Z,use_quota=True,user_id='ef985aa58e414ac5b63e038c9a428733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Creating volume 73d8c419-1c30-4a1b-bf4d-3392c55c2522 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:23:23 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73d8c419-1c30-4a1b-bf4d-3392c55c2522 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:23 devstack sudo[106449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73d8c419-1c30-4a1b-bf4d-3392c55c2522 1073741824
Jul 03 13:23:23 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (191b2576-7cf8-4c9c-b046-36e61b8d7270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7ceaf9c-1997-42d9-bf88-6754aa61b018', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe79c74-a386-4157-a6b9-dd2b06d95ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:23 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Volume volume-d7ceaf9c-1997-42d9-bf88-6754aa61b018 (d7ceaf9c-1997-42d9-bf88-6754aa61b018): created successfully
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe79c74-a386-4157-a6b9-dd2b06d95ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Flow 'volume_create_manager' (969eac67-065c-4ff0-9e01-0e72e11be3f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:23:23 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-e0c9d493-59d9-45f4-92c1-a37f3c4966db tempest-CreateVolumesFromImageTest-1334001682 None] Created volume successfully.
Jul 03 13:23:24 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73d8c419-1c30-4a1b-bf4d-3392c55c2522 1073741824" returned: 0 in 1.101s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73d8c419-1c30-4a1b-bf4d-3392c55c2522 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:24 devstack sudo[106455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73d8c419-1c30-4a1b-bf4d-3392c55c2522
Jul 03 13:23:24 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:25 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73d8c419-1c30-4a1b-bf4d-3392c55c2522" returned: 0 in 1.170s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] <== create_volume: return (2317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:23:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.320s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.564s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-928747525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce6c7a96-c2c5-444f-9f7d-53bfbc60a76f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ba6a8217764a49ad82c78678a62bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:23:22Z,use_quota=True,user_id='ef985aa58e414ac5b63e038c9a428733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:23:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Creating volume ce6c7a96-c2c5-444f-9f7d-53bfbc60a76f {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:23:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:23:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:23:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:23:26 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:23:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ce6c7a96-c2c5-444f-9f7d-53bfbc60a76f 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:26 devstack sudo[106494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ce6c7a96-c2c5-444f-9f7d-53bfbc60a76f 1073741824
Jul 03 13:23:26 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eebe448b-ba3e-420b-89d8-c39cccbda8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73d8c419-1c30-4a1b-bf4d-3392c55c2522', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b379a5c2-3ef5-4504-86b5-18158d9ca8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:26 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Volume volume-73d8c419-1c30-4a1b-bf4d-3392c55c2522 (73d8c419-1c30-4a1b-bf4d-3392c55c2522): created successfully
Jul 03 13:23:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b379a5c2-3ef5-4504-86b5-18158d9ca8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Flow 'volume_create_manager' (cbf2921b-af6b-4dff-843e-ac4f41cafdc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:23:26 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-93819683-fd41-47b4-9bec-ea9f55d8e6f7 tempest-CreateVolumesFromImageTest-1334001682 None] Created volume successfully.
Jul 03 13:23:26 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:23:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Flow 'volume_create_manager' (ed9cf922-5180-4e79-a769-f8a0c364b7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:23:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b42042-f798-4d64-9cf3-556925e365b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b42042-f798-4d64-9cf3-556925e365b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97091518ed0d4e89b783a0c3044ce4ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:23:26Z,use_quota=True,user_id='c149c734c6a244528f75069e46a1cb9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83fb6d48-8026-4169-a319-5a8907fbcf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83fb6d48-8026-4169-a319-5a8907fbcf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db243cdb-4c5a-4696-8af6-9574556edc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:26 devstack cinder-volume[86837]: DEBUG cinder.image.glance [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Creating Keystone auth plugin from conf {{(pid=86837) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 13:23:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db243cdb-4c5a-4696-8af6-9574556edc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8', 'volume_name': 'volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8', 'volume_size': 1, 'image_id': '75a69120-9f83-411b-be1d-7219511ff3bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75a69120-9f83-411b-be1d-7219511ff3bc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '37784a1f31dd0663f5bb23d3ca9ed840', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '97091518ed0d4e89b783a0c3044ce4ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd131a9528e9b84acc0f0ff9b3abf62714c40196eade49a3c3906befa30f337693b7db8e972a8e2794506163b46337c9b410510d5b050175561712cac8d55e88d', 'id': '75a69120-9f83-411b-be1d-7219511ff3bc', 'created_at': datetime.datetime(2026, 7, 3, 11, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75a69120-9f83-411b-be1d-7219511ff3bc/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7aa53c07e240>}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e49d0dc-42eb-4bb0-b5c1-bf88d332116f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e49d0dc-42eb-4bb0-b5c1-bf88d332116f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a77de1ad-cd97-4598-9d05-3a3b44f4db4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:26 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Volume 6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8', 'volume_size': 1, 'image_id': '75a69120-9f83-411b-be1d-7219511ff3bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75a69120-9f83-411b-be1d-7219511ff3bc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '37784a1f31dd0663f5bb23d3ca9ed840', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '97091518ed0d4e89b783a0c3044ce4ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd131a9528e9b84acc0f0ff9b3abf62714c40196eade49a3c3906befa30f337693b7db8e972a8e2794506163b46337c9b410510d5b050175561712cac8d55e88d', 'id': '75a69120-9f83-411b-be1d-7219511ff3bc', 'created_at': datetime.datetime(2026, 7, 3, 11, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75a69120-9f83-411b-be1d-7219511ff3bc/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7aa53c07e240>}
Jul 03 13:23:26 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Trying to clone 6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8 from image 75a69120-9f83-411b-be1d-7219511ff3bc at location (None, [{'url': 'file:///opt/stack/data/glance/images/75a69120-9f83-411b-be1d-7219511ff3bc', 'metadata': {}}]). {{(pid=86837) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 03 13:23:27 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_75a69120-9f83-411b-be1d-7219511ff3bc_7dqoj3c_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86837) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 03 13:23:27 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Image download 0.00 MB at 0.00 MB/s
Jul 03 13:23:27 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed237833-2dcf-40bf-b26a-565b0ba82027]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:23:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75a69120-9f83-411b-be1d-7219511ff3bc_7dqoj3c_devstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:27 devstack sudo[106500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75a69120-9f83-411b-be1d-7219511ff3bc_7dqoj3c_devstack@QuobyteHD
Jul 03 13:23:27 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:27 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ce6c7a96-c2c5-444f-9f7d-53bfbc60a76f 1073741824" returned: 0 in 1.384s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ce6c7a96-c2c5-444f-9f7d-53bfbc60a76f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:27 devstack sudo[106502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ce6c7a96-c2c5-444f-9f7d-53bfbc60a76f
Jul 03 13:23:27 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:27 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:23:27 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Flow 'volume_create_manager' (e0fdb5ca-cfa6-44cf-99c6-03575c92f6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:23:27 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0beaaa28-cacb-4d49-8d6e-5b6bda354c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:27 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0beaaa28-cacb-4d49-8d6e-5b6bda354c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38061a22-27e4-41c0-9330-84a6706d9732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='033619cdbf9c4e04a7a85c2f8a196da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:23:28Z,use_quota=True,user_id='73dd7974411441ad902610bb83470bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b2b2030-ff21-4d6d-9bb5-f8e15770b268),volume_type_id=6b2b2030-ff21-4d6d-9bb5-f8e15770b268)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:27 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6520881-f9fb-4ceb-b18f-11e06ecc48fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:27 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6520881-f9fb-4ceb-b18f-11e06ecc48fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:27 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4c6e64-8464-4098-a4c4-2e18fc30a8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:27 devstack cinder-volume[86837]: DEBUG cinder.image.glance [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Creating Keystone auth plugin from conf {{(pid=86837) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 13:23:28 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4c6e64-8464-4098-a4c4-2e18fc30a8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '38061a22-27e4-41c0-9330-84a6706d9732', 'volume_name': 'volume-38061a22-27e4-41c0-9330-84a6706d9732', 'volume_size': 1, 'image_id': '705ca459-7846-4c07-a59e-40369940b27c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/705ca459-7846-4c07-a59e-40369940b27c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6b43b4ca9759f98f9463fab3b2132a23', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '033619cdbf9c4e04a7a85c2f8a196da9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '907c744aa94ae41fc0bd59a7f9f6532382d796418ad5e82e1ad260e4c0288310e113069e1e24e73bb0ca3048b142b1a8c5a95b7f7253799fc4a4ea351f2fd0b6', 'id': '705ca459-7846-4c07-a59e-40369940b27c', 'created_at': datetime.datetime(2026, 7, 3, 11, 23, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 23, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/705ca459-7846-4c07-a59e-40369940b27c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7aa53be4bd70>}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:28 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f471eb-b0bc-4e35-8b9b-49243dd4dbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:28 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f471eb-b0bc-4e35-8b9b-49243dd4dbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:28 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd954ca-d5b8-40b9-8c6b-48db8bf6f16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:28 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Volume 38061a22-27e4-41c0-9330-84a6706d9732: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-38061a22-27e4-41c0-9330-84a6706d9732', 'volume_size': 1, 'image_id': '705ca459-7846-4c07-a59e-40369940b27c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/705ca459-7846-4c07-a59e-40369940b27c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6b43b4ca9759f98f9463fab3b2132a23', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '033619cdbf9c4e04a7a85c2f8a196da9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '907c744aa94ae41fc0bd59a7f9f6532382d796418ad5e82e1ad260e4c0288310e113069e1e24e73bb0ca3048b142b1a8c5a95b7f7253799fc4a4ea351f2fd0b6', 'id': '705ca459-7846-4c07-a59e-40369940b27c', 'created_at': datetime.datetime(2026, 7, 3, 11, 23, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 23, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/705ca459-7846-4c07-a59e-40369940b27c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7aa53be4bd70>}
Jul 03 13:23:28 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Trying to clone 38061a22-27e4-41c0-9330-84a6706d9732 from image 705ca459-7846-4c07-a59e-40369940b27c at location (None, [{'url': 'file:///opt/stack/data/glance/images/705ca459-7846-4c07-a59e-40369940b27c', 'metadata': {}}]). {{(pid=86837) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 03 13:23:28 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75a69120-9f83-411b-be1d-7219511ff3bc_7dqoj3c_devstack@QuobyteHD" returned: 0 in 1.030s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75a69120-9f83-411b-be1d-7219511ff3bc_7dqoj3c_devstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:28 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_705ca459-7846-4c07-a59e-40369940b27c_hsxo50sgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86837) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 03 13:23:28 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Image download 0.00 MB at 0.00 MB/s
Jul 03 13:23:28 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ce6c7a96-c2c5-444f-9f7d-53bfbc60a76f" returned: 0 in 0.882s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:28 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] <== create_volume: return (2348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:23:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.359s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.453s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:28 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-858897476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8deadbd6-fe80-4a1a-a12a-7e256f45e36f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ba6a8217764a49ad82c78678a62bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:23:23Z,use_quota=True,user_id='ef985aa58e414ac5b63e038c9a428733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:23:28 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Creating volume 8deadbd6-fe80-4a1a-a12a-7e256f45e36f {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:23:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:28 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:23:28 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:23:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:28 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:23:28 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:23:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8deadbd6-fe80-4a1a-a12a-7e256f45e36f 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:28 devstack sudo[106507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75a69120-9f83-411b-be1d-7219511ff3bc_7dqoj3c_devstack@QuobyteHD
Jul 03 13:23:28 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:28 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9a89e9-6731-4c7f-8d62-109591b608d3]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:23:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_705ca459-7846-4c07-a59e-40369940b27c_hsxo50sgdevstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:28 devstack sudo[106509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8deadbd6-fe80-4a1a-a12a-7e256f45e36f 1073741824
Jul 03 13:23:28 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:28 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef461c48-c487-4cb8-8d89-91cea868ec08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce6c7a96-c2c5-444f-9f7d-53bfbc60a76f', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:28 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28faf447-b128-49e6-8e52-3cf8b5fc6e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:28 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Volume volume-ce6c7a96-c2c5-444f-9f7d-53bfbc60a76f (ce6c7a96-c2c5-444f-9f7d-53bfbc60a76f): created successfully
Jul 03 13:23:28 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28faf447-b128-49e6-8e52-3cf8b5fc6e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:28 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Flow 'volume_create_manager' (7a7f0e2d-f0fd-4aab-b37d-c7f22d7f4943) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:23:28 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-e78a8928-e841-4db5-87f8-a5f04dd87919 tempest-CreateVolumesFromImageTest-1334001682 None] Created volume successfully.
Jul 03 13:23:28 devstack sudo[106510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_705ca459-7846-4c07-a59e-40369940b27c_hsxo50sgdevstack@QuobyteHD
Jul 03 13:23:28 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:29 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75a69120-9f83-411b-be1d-7219511ff3bc_7dqoj3c_devstack@QuobyteHD" returned: 1 in 0.955s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75a69120-9f83-411b-be1d-7219511ff3bc_7dqoj3c_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:23:29 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Temporary image 75a69120-9f83-411b-be1d-7219511ff3bc is fetched for user c149c734c6a244528f75069e46a1cb9e. {{(pid=86837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 03 13:23:29 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[53869943-a3f3-451d-8df1-a53dde753f82]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:23:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75a69120-9f83-411b-be1d-7219511ff3bc_7dqoj3c_devstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:29 devstack sudo[106521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75a69120-9f83-411b-be1d-7219511ff3bc_7dqoj3c_devstack@QuobyteHD
Jul 03 13:23:29 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:29 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_705ca459-7846-4c07-a59e-40369940b27c_hsxo50sgdevstack@QuobyteHD" returned: 0 in 1.072s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_705ca459-7846-4c07-a59e-40369940b27c_hsxo50sgdevstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:29 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8deadbd6-fe80-4a1a-a12a-7e256f45e36f 1073741824" returned: 0 in 1.161s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8deadbd6-fe80-4a1a-a12a-7e256f45e36f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:29 devstack sudo[106524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_705ca459-7846-4c07-a59e-40369940b27c_hsxo50sgdevstack@QuobyteHD
Jul 03 13:23:29 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:29 devstack sudo[106525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8deadbd6-fe80-4a1a-a12a-7e256f45e36f
Jul 03 13:23:29 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:29 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:23:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Flow 'volume_create_manager' (5e182892-be59-4344-a1c9-49de89e1e832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:23:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4094371a-6a68-48f1-bc15-c1d27df70b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4094371a-6a68-48f1-bc15-c1d27df70b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-216604624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9b9895e6094ba491a40e642c6a03b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:23:30Z,use_quota=True,user_id='8fca7bfb7d5b44a6a8b3f9e7153bf18a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb3d94ab-9593-4bfe-a347-03cf3353e435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb3d94ab-9593-4bfe-a347-03cf3353e435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b589e828-5f53-4971-9039-310a63789331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b589e828-5f53-4971-9039-310a63789331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65', 'volume_name': 'volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe49d08-fc12-4faa-a38a-2376767c98e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe49d08-fc12-4faa-a38a-2376767c98e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82579c1-251f-48c2-97e0-fa2611fb2d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:29 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Volume f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65', 'volume_size': 1}
Jul 03 13:23:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:30 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75a69120-9f83-411b-be1d-7219511ff3bc_7dqoj3c_devstack@QuobyteHD" returned: 0 in 0.903s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75a69120-9f83-411b-be1d-7219511ff3bc_7dqoj3c_devstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:30 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_705ca459-7846-4c07-a59e-40369940b27c_hsxo50sgdevstack@QuobyteHD" returned: 1 in 0.822s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_705ca459-7846-4c07-a59e-40369940b27c_hsxo50sgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:23:30 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Temporary image 705ca459-7846-4c07-a59e-40369940b27c is fetched for user 73dd7974411441ad902610bb83470bae. {{(pid=86837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 03 13:23:30 devstack sudo[106531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75a69120-9f83-411b-be1d-7219511ff3bc_7dqoj3c_devstack@QuobyteHD
Jul 03 13:23:30 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:30 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8deadbd6-fe80-4a1a-a12a-7e256f45e36f" returned: 0 in 0.733s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] <== create_volume: return (1961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:23:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.971s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.955s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1609124329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7689ff-a1fd-496b-8c0e-df2e2a19832c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ba6a8217764a49ad82c78678a62bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:23:23Z,use_quota=True,user_id='ef985aa58e414ac5b63e038c9a428733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:23:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Creating volume ae7689ff-a1fd-496b-8c0e-df2e2a19832c {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:23:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:23:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:23:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:23:30 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:23:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ae7689ff-a1fd-496b-8c0e-df2e2a19832c 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5237747c-1319-4478-a0da-010b22e48f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8deadbd6-fe80-4a1a-a12a-7e256f45e36f', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:30 devstack sudo[106536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ae7689ff-a1fd-496b-8c0e-df2e2a19832c 1073741824
Jul 03 13:23:30 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f4b0890-e114-4f58-afcd-daf126d680a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:30 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Volume volume-8deadbd6-fe80-4a1a-a12a-7e256f45e36f (8deadbd6-fe80-4a1a-a12a-7e256f45e36f): created successfully
Jul 03 13:23:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f4b0890-e114-4f58-afcd-daf126d680a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Flow 'volume_create_manager' (5c1631af-2050-4809-8e10-390bd91ad918) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:23:30 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb8191e-376f-4cf4-a509-66e77e069a25]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:23:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_705ca459-7846-4c07-a59e-40369940b27c_hsxo50sgdevstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:30 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-4f0fe71b-72d1-4a29-9542-8e8ad5d6d296 tempest-CreateVolumesFromImageTest-1334001682 None] Created volume successfully.
Jul 03 13:23:30 devstack sudo[106538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_705ca459-7846-4c07-a59e-40369940b27c_hsxo50sgdevstack@QuobyteHD
Jul 03 13:23:30 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:31 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75a69120-9f83-411b-be1d-7219511ff3bc_7dqoj3c_devstack@QuobyteHD" returned: 1 in 0.855s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75a69120-9f83-411b-be1d-7219511ff3bc_7dqoj3c_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:23:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:31 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ae7689ff-a1fd-496b-8c0e-df2e2a19832c 1073741824" returned: 0 in 0.899s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ae7689ff-a1fd-496b-8c0e-df2e2a19832c {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:31 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_705ca459-7846-4c07-a59e-40369940b27c_hsxo50sgdevstack@QuobyteHD" returned: 0 in 0.854s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_705ca459-7846-4c07-a59e-40369940b27c_hsxo50sgdevstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:31 devstack sudo[106548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ae7689ff-a1fd-496b-8c0e-df2e2a19832c
Jul 03 13:23:31 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:31 devstack sudo[106549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_705ca459-7846-4c07-a59e-40369940b27c_hsxo50sgdevstack@QuobyteHD
Jul 03 13:23:31 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:31 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ae7689ff-a1fd-496b-8c0e-df2e2a19832c" returned: 0 in 0.722s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:23:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.179s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-216604624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9b9895e6094ba491a40e642c6a03b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:23:30Z,use_quota=True,user_id='8fca7bfb7d5b44a6a8b3f9e7153bf18a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:23:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Creating volume f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:23:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:23:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:23:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:23:32 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:23:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:32 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_705ca459-7846-4c07-a59e-40369940b27c_hsxo50sgdevstack@QuobyteHD" returned: 1 in 0.746s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_705ca459-7846-4c07-a59e-40369940b27c_hsxo50sgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:23:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc48f74b-8699-4fc4-8232-59621a0f262e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae7689ff-a1fd-496b-8c0e-df2e2a19832c', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:32 devstack sudo[106556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65 1073741824
Jul 03 13:23:32 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfca2458-3812-40eb-b814-07a796f4977f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:32 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Volume volume-ae7689ff-a1fd-496b-8c0e-df2e2a19832c (ae7689ff-a1fd-496b-8c0e-df2e2a19832c): created successfully
Jul 03 13:23:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfca2458-3812-40eb-b814-07a796f4977f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Flow 'volume_create_manager' (324f90dc-f067-40c6-93bf-6e083897cc06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:23:32 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-139b2b37-e111-4044-83a0-8f874b278586 tempest-CreateVolumesFromImageTest-1334001682 None] Created volume successfully.
Jul 03 13:23:32 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65 1073741824" returned: 0 in 0.861s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:32 devstack sudo[106562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65
Jul 03 13:23:32 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:33 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-dfe643f2-be77-4d1e-bc31-6e7d2f0b7642 tempest-CreateVolumesFromImageTest-1334001682 None] Acquiring lock "cinder-ae7689ff-a1fd-496b-8c0e-df2e2a19832c-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:23:33 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-dfe643f2-be77-4d1e-bc31-6e7d2f0b7642 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "cinder-ae7689ff-a1fd-496b-8c0e-df2e2a19832c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:23:33 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-dfe643f2-be77-4d1e-bc31-6e7d2f0b7642 tempest-CreateVolumesFromImageTest-1334001682 None] Acquiring lock "cinder-quobyte-ae7689ff-a1fd-496b-8c0e-df2e2a19832c" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:23:33 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-dfe643f2-be77-4d1e-bc31-6e7d2f0b7642 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "cinder-quobyte-ae7689ff-a1fd-496b-8c0e-df2e2a19832c" acquired by "delete_volume" :: waited 0.013s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:23:33 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2c50ec-fc6c-46f5-8ab6-7ea2d2b92217]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:23:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dfe643f2-be77-4d1e-bc31-6e7d2f0b7642 tempest-CreateVolumesFromImageTest-1334001682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ae7689ff-a1fd-496b-8c0e-df2e2a19832c {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:33 devstack sudo[106565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ae7689ff-a1fd-496b-8c0e-df2e2a19832c
Jul 03 13:23:33 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:33 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65" returned: 0 in 0.686s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:33 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:23:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.571s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:33 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97091518ed0d4e89b783a0c3044ce4ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:23:26Z,use_quota=True,user_id='c149c734c6a244528f75069e46a1cb9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:23:33 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Creating volume 6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:23:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:33 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:23:33 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:23:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:33 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:23:33 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:23:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:33 devstack sudo[106568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8 1073741824
Jul 03 13:23:33 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82579c1-251f-48c2-97e0-fa2611fb2d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eaceecf-effa-41a6-9ba3-6e25fdd5fb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:33 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Volume volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65 (f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65): created successfully
Jul 03 13:23:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eaceecf-effa-41a6-9ba3-6e25fdd5fb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:33 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Flow 'volume_create_manager' (5e182892-be59-4344-a1c9-49de89e1e832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:23:33 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-9a86b1ab-c80c-43f4-840e-114cac6f1a84 tempest-ProjectReaderTests-1717421477 None] Created volume successfully.
Jul 03 13:23:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0064a997-1364-4172-a49d-f97fc82d9b7c tempest-ProjectReaderTests-1717421477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:34 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dfe643f2-be77-4d1e-bc31-6e7d2f0b7642 tempest-CreateVolumesFromImageTest-1334001682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ae7689ff-a1fd-496b-8c0e-df2e2a19832c" returned: 0 in 0.862s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dfe643f2-be77-4d1e-bc31-6e7d2f0b7642 tempest-CreateVolumesFromImageTest-1334001682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ae7689ff-a1fd-496b-8c0e-df2e2a19832c {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:34 devstack sudo[106573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ae7689ff-a1fd-496b-8c0e-df2e2a19832c
Jul 03 13:23:34 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:34 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8 1073741824" returned: 0 in 0.882s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:34 devstack sudo[106578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8
Jul 03 13:23:34 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:34 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dfe643f2-be77-4d1e-bc31-6e7d2f0b7642 tempest-CreateVolumesFromImageTest-1334001682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ae7689ff-a1fd-496b-8c0e-df2e2a19832c" returned: 0 in 0.695s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:34 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-dfe643f2-be77-4d1e-bc31-6e7d2f0b7642 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "cinder-quobyte-ae7689ff-a1fd-496b-8c0e-df2e2a19832c" released by "delete_volume" :: held 1.596s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:23:34 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-dfe643f2-be77-4d1e-bc31-6e7d2f0b7642 tempest-CreateVolumesFromImageTest-1334001682 None] Created reservations ['9611ddd4-c6b9-4a08-87a2-ab3a1045eb75', '58be8dbd-77a7-4ca5-b8aa-6361185d2101', 'ef844ef3-6b9e-4a71-a3dd-fb86f40f2bc8', '9d5b10b4-6e54-48e9-a418-16155c94fbfb'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:23:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-dfe643f2-be77-4d1e-bc31-6e7d2f0b7642 tempest-CreateVolumesFromImageTest-1334001682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-dfe643f2-be77-4d1e-bc31-6e7d2f0b7642 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-dfe643f2-be77-4d1e-bc31-6e7d2f0b7642 tempest-CreateVolumesFromImageTest-1334001682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:23:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-dfe643f2-be77-4d1e-bc31-6e7d2f0b7642 tempest-CreateVolumesFromImageTest-1334001682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:23:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-dfe643f2-be77-4d1e-bc31-6e7d2f0b7642 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dfe643f2-be77-4d1e-bc31-6e7d2f0b7642 tempest-CreateVolumesFromImageTest-1334001682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:34 devstack sudo[106581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:23:34 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:35 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8" returned: 0 in 0.713s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:23:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.207s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38061a22-27e4-41c0-9330-84a6706d9732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='033619cdbf9c4e04a7a85c2f8a196da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:23:28Z,use_quota=True,user_id='73dd7974411441ad902610bb83470bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b2b2030-ff21-4d6d-9bb5-f8e15770b268),volume_type_id=6b2b2030-ff21-4d6d-9bb5-f8e15770b268)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:23:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Creating volume 38061a22-27e4-41c0-9330-84a6706d9732 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:23:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:23:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:23:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:23:35 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:23:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:35 devstack sudo[106584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732 1073741824
Jul 03 13:23:35 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:35 devstack cinder-volume[86837]: DEBUG cinder.volume.volume_utils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Attempting download of 75a69120-9f83-411b-be1d-7219511ff3bc ((None, [{'url': 'file:///opt/stack/data/glance/images/75a69120-9f83-411b-be1d-7219511ff3bc', 'metadata': {}}])) to volume 6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8. {{(pid=86837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 03 13:23:35 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[140fcbc8-43af-4e93-80f5-0e6ddaca8592]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:23:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75a69120-9f83-411b-be1d-7219511ff3bc_15ml9jhk {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:35 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2893ee68-476b-46ef-b565-c35c55e2b856 tempest-CreateVolumesFromImageTest-1334001682 None] Acquiring lock "cinder-8deadbd6-fe80-4a1a-a12a-7e256f45e36f-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:23:35 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2893ee68-476b-46ef-b565-c35c55e2b856 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "cinder-8deadbd6-fe80-4a1a-a12a-7e256f45e36f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:23:35 devstack sudo[106586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75a69120-9f83-411b-be1d-7219511ff3bc_15ml9jhk
Jul 03 13:23:35 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:35 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2893ee68-476b-46ef-b565-c35c55e2b856 tempest-CreateVolumesFromImageTest-1334001682 None] Acquiring lock "cinder-quobyte-8deadbd6-fe80-4a1a-a12a-7e256f45e36f" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:23:35 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2893ee68-476b-46ef-b565-c35c55e2b856 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "cinder-quobyte-8deadbd6-fe80-4a1a-a12a-7e256f45e36f" acquired by "delete_volume" :: waited 0.022s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:23:35 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abe1d24-d58e-475d-9d4b-2213d85dc955]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:23:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2893ee68-476b-46ef-b565-c35c55e2b856 tempest-CreateVolumesFromImageTest-1334001682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8deadbd6-fe80-4a1a-a12a-7e256f45e36f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:35 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dfe643f2-be77-4d1e-bc31-6e7d2f0b7642 tempest-CreateVolumesFromImageTest-1334001682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.687s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:35 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-dfe643f2-be77-4d1e-bc31-6e7d2f0b7642 tempest-CreateVolumesFromImageTest-1334001682 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:23:35 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-dfe643f2-be77-4d1e-bc31-6e7d2f0b7642 tempest-CreateVolumesFromImageTest-1334001682 None] Deleted volume successfully.
Jul 03 13:23:35 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-dfe643f2-be77-4d1e-bc31-6e7d2f0b7642 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "cinder-ae7689ff-a1fd-496b-8c0e-df2e2a19832c-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:23:35 devstack sudo[106589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8deadbd6-fe80-4a1a-a12a-7e256f45e36f
Jul 03 13:23:35 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:36 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732 1073741824" returned: 0 in 0.982s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:36 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75a69120-9f83-411b-be1d-7219511ff3bc_15ml9jhk" returned: 0 in 0.897s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75a69120-9f83-411b-be1d-7219511ff3bc_15ml9jhk {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:36 devstack sudo[106598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732
Jul 03 13:23:36 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:36 devstack sudo[106597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75a69120-9f83-411b-be1d-7219511ff3bc_15ml9jhk
Jul 03 13:23:36 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:36 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2893ee68-476b-46ef-b565-c35c55e2b856 tempest-CreateVolumesFromImageTest-1334001682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8deadbd6-fe80-4a1a-a12a-7e256f45e36f" returned: 0 in 0.928s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2893ee68-476b-46ef-b565-c35c55e2b856 tempest-CreateVolumesFromImageTest-1334001682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8deadbd6-fe80-4a1a-a12a-7e256f45e36f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:36 devstack sudo[106604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8deadbd6-fe80-4a1a-a12a-7e256f45e36f
Jul 03 13:23:36 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:36 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732" returned: 0 in 0.680s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:23:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0064a997-1364-4172-a49d-f97fc82d9b7c tempest-ProjectReaderTests-1717421477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.886s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-0064a997-1364-4172-a49d-f97fc82d9b7c tempest-ProjectReaderTests-1717421477 None] Creating offline snapshot 0f13b327-c84e-4ff7-a729-430c00a5d7b7 of volume f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65 {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:23:37 devstack cinder-volume[86837]: DEBUG cinder.volume.volume_utils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Attempting download of 705ca459-7846-4c07-a59e-40369940b27c ((None, [{'url': 'file:///opt/stack/data/glance/images/705ca459-7846-4c07-a59e-40369940b27c', 'metadata': {}}])) to volume 38061a22-27e4-41c0-9330-84a6706d9732. {{(pid=86837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 03 13:23:37 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e8a04c-d4b9-41ad-beea-0bc133e48cf3]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:23:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0064a997-1364-4172-a49d-f97fc82d9b7c tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:37 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[32256a04-ac6b-4b14-a12c-40de2f3bf920]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:23:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_705ca459-7846-4c07-a59e-40369940b27c_j0bxegig {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:37 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75a69120-9f83-411b-be1d-7219511ff3bc_15ml9jhk" returned: 1 in 0.835s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75a69120-9f83-411b-be1d-7219511ff3bc_15ml9jhk' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:23:37 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[842e68a1-acb4-449e-b0b9-7278f7894173]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:23:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75a69120-9f83-411b-be1d-7219511ff3bc_7dqoj3c_devstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:37 devstack sudo[106610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_705ca459-7846-4c07-a59e-40369940b27c_j0bxegig
Jul 03 13:23:37 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:37 devstack sudo[106609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65
Jul 03 13:23:37 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:37 devstack sudo[106611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75a69120-9f83-411b-be1d-7219511ff3bc_7dqoj3c_devstack@QuobyteHD
Jul 03 13:23:37 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:37 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2893ee68-476b-46ef-b565-c35c55e2b856 tempest-CreateVolumesFromImageTest-1334001682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8deadbd6-fe80-4a1a-a12a-7e256f45e36f" returned: 0 in 0.775s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:37 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2893ee68-476b-46ef-b565-c35c55e2b856 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "cinder-quobyte-8deadbd6-fe80-4a1a-a12a-7e256f45e36f" released by "delete_volume" :: held 1.767s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:23:37 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-2893ee68-476b-46ef-b565-c35c55e2b856 tempest-CreateVolumesFromImageTest-1334001682 None] Created reservations ['1ef102d5-e7c5-4f74-bb31-612e3101056a', '38b9a2ef-26a8-4fcd-baaf-0d467878ddf7', '05e0680d-4d7c-4520-a6d0-d1ed085aac98', 'e7baf772-60aa-4399-8bfc-070fd359a657'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:23:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-2893ee68-476b-46ef-b565-c35c55e2b856 tempest-CreateVolumesFromImageTest-1334001682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-2893ee68-476b-46ef-b565-c35c55e2b856 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-2893ee68-476b-46ef-b565-c35c55e2b856 tempest-CreateVolumesFromImageTest-1334001682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:23:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-2893ee68-476b-46ef-b565-c35c55e2b856 tempest-CreateVolumesFromImageTest-1334001682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:23:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-2893ee68-476b-46ef-b565-c35c55e2b856 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2893ee68-476b-46ef-b565-c35c55e2b856 tempest-CreateVolumesFromImageTest-1334001682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:37 devstack sudo[106616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:23:37 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:37 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-325520cc-5937-475f-a6c3-cbd4853d3513 tempest-CreateVolumesFromImageTest-1334001682 None] Acquiring lock "cinder-ce6c7a96-c2c5-444f-9f7d-53bfbc60a76f-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:23:37 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-325520cc-5937-475f-a6c3-cbd4853d3513 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "cinder-ce6c7a96-c2c5-444f-9f7d-53bfbc60a76f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:23:37 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-325520cc-5937-475f-a6c3-cbd4853d3513 tempest-CreateVolumesFromImageTest-1334001682 None] Acquiring lock "cinder-quobyte-ce6c7a96-c2c5-444f-9f7d-53bfbc60a76f" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:23:37 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-325520cc-5937-475f-a6c3-cbd4853d3513 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "cinder-quobyte-ce6c7a96-c2c5-444f-9f7d-53bfbc60a76f" acquired by "delete_volume" :: waited 0.035s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:23:37 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e611d734-56f7-4a6b-9fb4-096b80a6b562]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:23:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-325520cc-5937-475f-a6c3-cbd4853d3513 tempest-CreateVolumesFromImageTest-1334001682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ce6c7a96-c2c5-444f-9f7d-53bfbc60a76f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:38 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75a69120-9f83-411b-be1d-7219511ff3bc_7dqoj3c_devstack@QuobyteHD" returned: 0 in 0.918s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75a69120-9f83-411b-be1d-7219511ff3bc_7dqoj3c_devstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:38 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0064a997-1364-4172-a49d-f97fc82d9b7c tempest-ProjectReaderTests-1717421477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65" returned: 0 in 1.028s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0064a997-1364-4172-a49d-f97fc82d9b7c tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65.0f13b327-c84e-4ff7-a729-430c00a5d7b7 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:38 devstack sudo[106627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65.0f13b327-c84e-4ff7-a729-430c00a5d7b7 1G
Jul 03 13:23:38 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:38 devstack sudo[106625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75a69120-9f83-411b-be1d-7219511ff3bc_7dqoj3c_devstack@QuobyteHD
Jul 03 13:23:38 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:38 devstack sudo[106623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ce6c7a96-c2c5-444f-9f7d-53bfbc60a76f
Jul 03 13:23:38 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:38 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_705ca459-7846-4c07-a59e-40369940b27c_j0bxegig" returned: 0 in 1.119s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_705ca459-7846-4c07-a59e-40369940b27c_j0bxegig {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:38 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2893ee68-476b-46ef-b565-c35c55e2b856 tempest-CreateVolumesFromImageTest-1334001682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.812s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:38 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-2893ee68-476b-46ef-b565-c35c55e2b856 tempest-CreateVolumesFromImageTest-1334001682 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:23:38 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-2893ee68-476b-46ef-b565-c35c55e2b856 tempest-CreateVolumesFromImageTest-1334001682 None] Deleted volume successfully.
Jul 03 13:23:38 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2893ee68-476b-46ef-b565-c35c55e2b856 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "cinder-8deadbd6-fe80-4a1a-a12a-7e256f45e36f-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:23:38 devstack sudo[106632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_705ca459-7846-4c07-a59e-40369940b27c_j0bxegig
Jul 03 13:23:38 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:38 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75a69120-9f83-411b-be1d-7219511ff3bc_7dqoj3c_devstack@QuobyteHD" returned: 1 in 0.859s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75a69120-9f83-411b-be1d-7219511ff3bc_7dqoj3c_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:23:38 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] 75a69120-9f83-411b-be1d-7219511ff3bc was raw, converting to raw {{(pid=86837) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 03 13:23:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_75a69120-9f83-411b-be1d-7219511ff3bc_7dqoj3c_devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:38 devstack sudo[106644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_75a69120-9f83-411b-be1d-7219511ff3bc_7dqoj3c_devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8
Jul 03 13:23:38 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:39 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-325520cc-5937-475f-a6c3-cbd4853d3513 tempest-CreateVolumesFromImageTest-1334001682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ce6c7a96-c2c5-444f-9f7d-53bfbc60a76f" returned: 0 in 1.030s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-325520cc-5937-475f-a6c3-cbd4853d3513 tempest-CreateVolumesFromImageTest-1334001682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ce6c7a96-c2c5-444f-9f7d-53bfbc60a76f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:39 devstack sudo[106648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ce6c7a96-c2c5-444f-9f7d-53bfbc60a76f
Jul 03 13:23:39 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:39 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_705ca459-7846-4c07-a59e-40369940b27c_j0bxegig" returned: 1 in 0.904s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_705ca459-7846-4c07-a59e-40369940b27c_j0bxegig' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:23:39 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1e057e-ec90-4984-95f7-cebebdb1401d]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:23:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_705ca459-7846-4c07-a59e-40369940b27c_hsxo50sgdevstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:39 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0064a997-1364-4172-a49d-f97fc82d9b7c tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65.0f13b327-c84e-4ff7-a729-430c00a5d7b7 1G" returned: 0 in 1.126s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0064a997-1364-4172-a49d-f97fc82d9b7c tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65.0f13b327-c84e-4ff7-a729-430c00a5d7b7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:39 devstack sudo[106651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65.0f13b327-c84e-4ff7-a729-430c00a5d7b7
Jul 03 13:23:39 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:39 devstack sudo[106650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_705ca459-7846-4c07-a59e-40369940b27c_hsxo50sgdevstack@QuobyteHD
Jul 03 13:23:39 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:39 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-325520cc-5937-475f-a6c3-cbd4853d3513 tempest-CreateVolumesFromImageTest-1334001682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ce6c7a96-c2c5-444f-9f7d-53bfbc60a76f" returned: 0 in 0.701s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:39 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-325520cc-5937-475f-a6c3-cbd4853d3513 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "cinder-quobyte-ce6c7a96-c2c5-444f-9f7d-53bfbc60a76f" released by "delete_volume" :: held 1.804s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:23:39 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_75a69120-9f83-411b-be1d-7219511ff3bc_7dqoj3c_devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8" returned: 0 in 0.876s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:39 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_75a69120-9f83-411b-be1d-7219511ff3bc_7dqoj3c_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8 {{(pid=86837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 13:23:39 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Converted 0.00 MB image at 0.00 MB/s
Jul 03 13:23:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:39 devstack sudo[106658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8 1G
Jul 03 13:23:39 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:39 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-325520cc-5937-475f-a6c3-cbd4853d3513 tempest-CreateVolumesFromImageTest-1334001682 None] Created reservations ['28a179c9-6ae8-4f7e-bf2c-e110b7a819ba', 'ec6b6b8d-e862-41a3-a8d8-2e3e0624d8e0', 'ff7f73f9-61ce-4737-86a4-6912de765097', '2af58a04-812a-457c-a5d6-aacf7fdcb4a4'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:23:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-325520cc-5937-475f-a6c3-cbd4853d3513 tempest-CreateVolumesFromImageTest-1334001682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-325520cc-5937-475f-a6c3-cbd4853d3513 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-325520cc-5937-475f-a6c3-cbd4853d3513 tempest-CreateVolumesFromImageTest-1334001682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:23:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-325520cc-5937-475f-a6c3-cbd4853d3513 tempest-CreateVolumesFromImageTest-1334001682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:23:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-325520cc-5937-475f-a6c3-cbd4853d3513 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-325520cc-5937-475f-a6c3-cbd4853d3513 tempest-CreateVolumesFromImageTest-1334001682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:39 devstack sudo[106666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:23:39 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:39 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0064a997-1364-4172-a49d-f97fc82d9b7c tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65.0f13b327-c84e-4ff7-a729-430c00a5d7b7" returned: 0 in 0.795s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:39 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-0064a997-1364-4172-a49d-f97fc82d9b7c tempest-ProjectReaderTests-1717421477 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65.0f13b327-c84e-4ff7-a729-430c00a5d7b7 is being set with open permissions: ugo+rw
Jul 03 13:23:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0064a997-1364-4172-a49d-f97fc82d9b7c tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65.0f13b327-c84e-4ff7-a729-430c00a5d7b7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:39 devstack sudo[106668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65.0f13b327-c84e-4ff7-a729-430c00a5d7b7
Jul 03 13:23:39 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:40 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_705ca459-7846-4c07-a59e-40369940b27c_hsxo50sgdevstack@QuobyteHD" returned: 0 in 0.914s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_705ca459-7846-4c07-a59e-40369940b27c_hsxo50sgdevstack@QuobyteHD {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-67d0a1da-c783-4496-b75e-a148f0c93569 tempest-CreateVolumesFromImageTest-1334001682 None] Acquiring lock "cinder-73d8c419-1c30-4a1b-bf4d-3392c55c2522-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:23:40 devstack sudo[106670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_705ca459-7846-4c07-a59e-40369940b27c_hsxo50sgdevstack@QuobyteHD
Jul 03 13:23:40 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-67d0a1da-c783-4496-b75e-a148f0c93569 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "cinder-73d8c419-1c30-4a1b-bf4d-3392c55c2522-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:23:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-67d0a1da-c783-4496-b75e-a148f0c93569 tempest-CreateVolumesFromImageTest-1334001682 None] Acquiring lock "cinder-quobyte-73d8c419-1c30-4a1b-bf4d-3392c55c2522" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:23:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-67d0a1da-c783-4496-b75e-a148f0c93569 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "cinder-quobyte-73d8c419-1c30-4a1b-bf4d-3392c55c2522" acquired by "delete_volume" :: waited 0.026s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:23:40 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b389aa-1923-443e-b943-d59727261551]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:23:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-67d0a1da-c783-4496-b75e-a148f0c93569 tempest-CreateVolumesFromImageTest-1334001682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73d8c419-1c30-4a1b-bf4d-3392c55c2522 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:40 devstack sudo[106672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73d8c419-1c30-4a1b-bf4d-3392c55c2522
Jul 03 13:23:40 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:40 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-325520cc-5937-475f-a6c3-cbd4853d3513 tempest-CreateVolumesFromImageTest-1334001682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.742s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:40 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-325520cc-5937-475f-a6c3-cbd4853d3513 tempest-CreateVolumesFromImageTest-1334001682 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:23:40 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-325520cc-5937-475f-a6c3-cbd4853d3513 tempest-CreateVolumesFromImageTest-1334001682 None] Deleted volume successfully.
Jul 03 13:23:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-325520cc-5937-475f-a6c3-cbd4853d3513 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "cinder-ce6c7a96-c2c5-444f-9f7d-53bfbc60a76f-delete_volume" released by "delete_volume" :: held 2.907s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:23:40 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8 1G" returned: 0 in 1.075s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:40 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64c781b-1c07-4d60-9f67-95556ccbdec0]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:23:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:40 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0064a997-1364-4172-a49d-f97fc82d9b7c tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65.0f13b327-c84e-4ff7-a729-430c00a5d7b7" returned: 0 in 0.947s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0064a997-1364-4172-a49d-f97fc82d9b7c tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:40 devstack sudo[106683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65.info
Jul 03 13:23:40 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:40 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_705ca459-7846-4c07-a59e-40369940b27c_hsxo50sgdevstack@QuobyteHD" returned: 1 in 0.967s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_705ca459-7846-4c07-a59e-40369940b27c_hsxo50sgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:23:40 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] 705ca459-7846-4c07-a59e-40369940b27c was raw, converting to raw {{(pid=86837) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 03 13:23:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_705ca459-7846-4c07-a59e-40369940b27c_hsxo50sgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:41 devstack sudo[106682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8
Jul 03 13:23:41 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:41 devstack sudo[106685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_705ca459-7846-4c07-a59e-40369940b27c_hsxo50sgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732
Jul 03 13:23:41 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:41 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-67d0a1da-c783-4496-b75e-a148f0c93569 tempest-CreateVolumesFromImageTest-1334001682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73d8c419-1c30-4a1b-bf4d-3392c55c2522" returned: 0 in 0.999s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-67d0a1da-c783-4496-b75e-a148f0c93569 tempest-CreateVolumesFromImageTest-1334001682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73d8c419-1c30-4a1b-bf4d-3392c55c2522 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:41 devstack sudo[106691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73d8c419-1c30-4a1b-bf4d-3392c55c2522
Jul 03 13:23:41 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:41 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0064a997-1364-4172-a49d-f97fc82d9b7c tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65.info" returned: 0 in 0.778s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:41 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-0064a997-1364-4172-a49d-f97fc82d9b7c tempest-ProjectReaderTests-1717421477 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65.info is being set with open permissions: ugo+rw
Jul 03 13:23:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0064a997-1364-4172-a49d-f97fc82d9b7c tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:41 devstack sudo[106699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65.info
Jul 03 13:23:41 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:41 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_705ca459-7846-4c07-a59e-40369940b27c_hsxo50sgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732" returned: 0 in 0.862s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:41 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_705ca459-7846-4c07-a59e-40369940b27c_hsxo50sgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732 {{(pid=86837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 13:23:41 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:41 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Converted 0.00 MB image at 0.00 MB/s
Jul 03 13:23:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8" returned: 0 in 0.991s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:41 devstack sudo[106701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732 1G
Jul 03 13:23:41 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:41 devstack sudo[106702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8
Jul 03 13:23:41 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:42 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-67d0a1da-c783-4496-b75e-a148f0c93569 tempest-CreateVolumesFromImageTest-1334001682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-73d8c419-1c30-4a1b-bf4d-3392c55c2522" returned: 0 in 0.742s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-67d0a1da-c783-4496-b75e-a148f0c93569 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "cinder-quobyte-73d8c419-1c30-4a1b-bf4d-3392c55c2522" released by "delete_volume" :: held 1.815s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-67d0a1da-c783-4496-b75e-a148f0c93569 tempest-CreateVolumesFromImageTest-1334001682 None] Created reservations ['393db15c-dc60-4309-9456-8d3e3fc17481', '0f544250-c4ea-41e9-8bae-1f9192d90efc', 'f19a6dda-59c7-4b70-88d9-9002ea332c99', '41c8fdf6-fc54-4860-b5aa-727840823ac5'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-67d0a1da-c783-4496-b75e-a148f0c93569 tempest-CreateVolumesFromImageTest-1334001682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-67d0a1da-c783-4496-b75e-a148f0c93569 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-67d0a1da-c783-4496-b75e-a148f0c93569 tempest-CreateVolumesFromImageTest-1334001682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-67d0a1da-c783-4496-b75e-a148f0c93569 tempest-CreateVolumesFromImageTest-1334001682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-67d0a1da-c783-4496-b75e-a148f0c93569 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-67d0a1da-c783-4496-b75e-a148f0c93569 tempest-CreateVolumesFromImageTest-1334001682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:42 devstack sudo[106707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:23:42 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:42 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0064a997-1364-4172-a49d-f97fc82d9b7c tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65.info" returned: 0 in 0.789s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0064a997-1364-4172-a49d-f97fc82d9b7c tempest-ProjectReaderTests-1717421477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.573s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:42 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-0064a997-1364-4172-a49d-f97fc82d9b7c tempest-ProjectReaderTests-1717421477 None] Create snapshot completed successfully
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9f06950c-9177-4f4c-9eba-56c8b062f51f tempest-CreateVolumesFromImageTest-1334001682 None] Acquiring lock "cinder-d7ceaf9c-1997-42d9-bf88-6754aa61b018-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9f06950c-9177-4f4c-9eba-56c8b062f51f tempest-CreateVolumesFromImageTest-1334001682 None] Lock "cinder-d7ceaf9c-1997-42d9-bf88-6754aa61b018-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9f06950c-9177-4f4c-9eba-56c8b062f51f tempest-CreateVolumesFromImageTest-1334001682 None] Acquiring lock "cinder-quobyte-d7ceaf9c-1997-42d9-bf88-6754aa61b018" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:23:42 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9f06950c-9177-4f4c-9eba-56c8b062f51f tempest-CreateVolumesFromImageTest-1334001682 None] Lock "cinder-quobyte-d7ceaf9c-1997-42d9-bf88-6754aa61b018" acquired by "delete_volume" :: waited 0.033s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8" returned: 1 in 0.895s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG cinder.volume.volume_utils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Downloaded image 75a69120-9f83-411b-be1d-7219511ff3bc ((None, [{'url': 'file:///opt/stack/data/glance/images/75a69120-9f83-411b-be1d-7219511ff3bc', 'metadata': {}}])) to volume 6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8 successfully. {{(pid=86837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Temporary image 75a69120-9f83-411b-be1d-7219511ff3bc for user c149c734c6a244528f75069e46a1cb9e is deleted. {{(pid=86837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG cinder.volume.volume_utils [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Marking volume 6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8 as bootable. {{(pid=86837) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 03 13:23:42 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c6b31f-5139-4ddc-bbc1-b3022e70804c]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9f06950c-9177-4f4c-9eba-56c8b062f51f tempest-CreateVolumesFromImageTest-1334001682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d7ceaf9c-1997-42d9-bf88-6754aa61b018 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Copying metadata from image 75a69120-9f83-411b-be1d-7219511ff3bc to 6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8. {{(pid=86837) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Creating volume glance metadata for volume 6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8 backed by image 75a69120-9f83-411b-be1d-7219511ff3bc with: {'image_id': '75a69120-9f83-411b-be1d-7219511ff3bc', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '37784a1f31dd0663f5bb23d3ca9ed840', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86837) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732 1G" returned: 0 in 0.953s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e965ad92-91b9-4213-9aba-f1b928dfe9e9]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a77de1ad-cd97-4598-9d05-3a3b44f4db4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8', 'volume_size': 1, 'image_id': '75a69120-9f83-411b-be1d-7219511ff3bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75a69120-9f83-411b-be1d-7219511ff3bc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '37784a1f31dd0663f5bb23d3ca9ed840', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '97091518ed0d4e89b783a0c3044ce4ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd131a9528e9b84acc0f0ff9b3abf62714c40196eade49a3c3906befa30f337693b7db8e972a8e2794506163b46337c9b410510d5b050175561712cac8d55e88d', 'id': '75a69120-9f83-411b-be1d-7219511ff3bc', 'created_at': datetime.datetime(2026, 7, 3, 11, 23, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 23, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75a69120-9f83-411b-be1d-7219511ff3bc/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7aa53c07e240>}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6eb171-637b-42bf-a9d2-db2b28cc7262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:42 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Volume volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8 (6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8): created successfully
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6eb171-637b-42bf-a9d2-db2b28cc7262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:42 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Flow 'volume_create_manager' (ed9cf922-5180-4e79-a769-f8a0c364b7f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:23:42 devstack sudo[106715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d7ceaf9c-1997-42d9-bf88-6754aa61b018
Jul 03 13:23:42 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:42 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-6b63af2c-5eff-4462-bf4b-e5f747a48063 tempest-VolumeImageDependencyTests-409777805 None] Created volume successfully.
Jul 03 13:23:43 devstack sudo[106716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732
Jul 03 13:23:43 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:43 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-67d0a1da-c783-4496-b75e-a148f0c93569 tempest-CreateVolumesFromImageTest-1334001682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.791s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:43 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-67d0a1da-c783-4496-b75e-a148f0c93569 tempest-CreateVolumesFromImageTest-1334001682 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:23:43 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-67d0a1da-c783-4496-b75e-a148f0c93569 tempest-CreateVolumesFromImageTest-1334001682 None] Deleted volume successfully.
Jul 03 13:23:43 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-67d0a1da-c783-4496-b75e-a148f0c93569 tempest-CreateVolumesFromImageTest-1334001682 None] Lock "cinder-73d8c419-1c30-4a1b-bf4d-3392c55c2522-delete_volume" released by "delete_volume" :: held 2.899s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:23:43 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a1e99baf-83d9-4397-98fe-d93a8a6efdb1 tempest-VolumeImageDependencyTests-409777805 None] Acquiring lock "cinder-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:23:43 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a1e99baf-83d9-4397-98fe-d93a8a6efdb1 tempest-VolumeImageDependencyTests-409777805 None] Lock "cinder-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:23:43 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732" returned: 0 in 0.831s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:43 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a1e99baf-83d9-4397-98fe-d93a8a6efdb1 tempest-VolumeImageDependencyTests-409777805 None] Acquiring lock "cinder-quobyte-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:23:43 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9f06950c-9177-4f4c-9eba-56c8b062f51f tempest-CreateVolumesFromImageTest-1334001682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d7ceaf9c-1997-42d9-bf88-6754aa61b018" returned: 0 in 1.013s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9f06950c-9177-4f4c-9eba-56c8b062f51f tempest-CreateVolumesFromImageTest-1334001682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d7ceaf9c-1997-42d9-bf88-6754aa61b018 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:43 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a1e99baf-83d9-4397-98fe-d93a8a6efdb1 tempest-VolumeImageDependencyTests-409777805 None] Lock "cinder-quobyte-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8" acquired by "delete_volume" :: waited 0.049s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:23:43 devstack sudo[106728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d7ceaf9c-1997-42d9-bf88-6754aa61b018
Jul 03 13:23:43 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:43 devstack sudo[106727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732
Jul 03 13:23:43 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:43 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-973a728e-c380-4d49-9cea-85832a8eb521 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "cinder-0f13b327-c84e-4ff7-a729-430c00a5d7b7-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:23:43 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-973a728e-c380-4d49-9cea-85832a8eb521 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-0f13b327-c84e-4ff7-a729-430c00a5d7b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:23:43 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-973a728e-c380-4d49-9cea-85832a8eb521 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "cinder-quobyte-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:23:43 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3254bfbe-ecc2-4469-a661-68ca562bb4b3]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:23:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a1e99baf-83d9-4397-98fe-d93a8a6efdb1 tempest-VolumeImageDependencyTests-409777805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:43 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-973a728e-c380-4d49-9cea-85832a8eb521 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65" acquired by "delete_snapshot" :: waited 0.060s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:23:43 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-973a728e-c380-4d49-9cea-85832a8eb521 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "cinder-quobyte-0f13b327-c84e-4ff7-a729-430c00a5d7b7" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:23:44 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-973a728e-c380-4d49-9cea-85832a8eb521 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-0f13b327-c84e-4ff7-a729-430c00a5d7b7" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:23:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-973a728e-c380-4d49-9cea-85832a8eb521 tempest-ProjectReaderTests-1717421477 None] Deleting offline snapshot 0f13b327-c84e-4ff7-a729-430c00a5d7b7 of volume f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:23:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-973a728e-c380-4d49-9cea-85832a8eb521 tempest-ProjectReaderTests-1717421477 None] snapshot_file for this snap is: volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65.0f13b327-c84e-4ff7-a729-430c00a5d7b7 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:23:44 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[8075c9d6-db6c-4afd-8c9b-2e1833df871f]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:23:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-973a728e-c380-4d49-9cea-85832a8eb521 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65.0f13b327-c84e-4ff7-a729-430c00a5d7b7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:44 devstack sudo[106731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8
Jul 03 13:23:44 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:44 devstack sudo[106732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65.0f13b327-c84e-4ff7-a729-430c00a5d7b7
Jul 03 13:23:44 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:44 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9f06950c-9177-4f4c-9eba-56c8b062f51f tempest-CreateVolumesFromImageTest-1334001682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d7ceaf9c-1997-42d9-bf88-6754aa61b018" returned: 0 in 0.788s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:44 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9f06950c-9177-4f4c-9eba-56c8b062f51f tempest-CreateVolumesFromImageTest-1334001682 None] Lock "cinder-quobyte-d7ceaf9c-1997-42d9-bf88-6754aa61b018" released by "delete_volume" :: held 1.863s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:23:44 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732" returned: 1 in 0.957s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:23:44 devstack cinder-volume[86837]: DEBUG cinder.volume.volume_utils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Downloaded image 705ca459-7846-4c07-a59e-40369940b27c ((None, [{'url': 'file:///opt/stack/data/glance/images/705ca459-7846-4c07-a59e-40369940b27c', 'metadata': {}}])) to volume 38061a22-27e4-41c0-9330-84a6706d9732 successfully. {{(pid=86837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 03 13:23:44 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Temporary image 705ca459-7846-4c07-a59e-40369940b27c for user 73dd7974411441ad902610bb83470bae is deleted. {{(pid=86837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 03 13:23:44 devstack cinder-volume[86837]: DEBUG cinder.volume.volume_utils [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Marking volume 38061a22-27e4-41c0-9330-84a6706d9732 as bootable. {{(pid=86837) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 03 13:23:44 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-9f06950c-9177-4f4c-9eba-56c8b062f51f tempest-CreateVolumesFromImageTest-1334001682 None] Created reservations ['f7763528-dede-4c5a-b7d0-ae1cd9a486f9', '0ab47495-8e5e-45cb-ab09-9fe1b8759d12', 'ac94d7e9-2eae-48fc-9528-a19348a1d23f', '96b954f0-aa91-4b6b-8931-ee9214bcf62a'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:23:44 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Copying metadata from image 705ca459-7846-4c07-a59e-40369940b27c to 38061a22-27e4-41c0-9330-84a6706d9732. {{(pid=86837) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 13:23:44 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Creating volume glance metadata for volume 38061a22-27e4-41c0-9330-84a6706d9732 backed by image 705ca459-7846-4c07-a59e-40369940b27c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '705ca459-7846-4c07-a59e-40369940b27c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '6b43b4ca9759f98f9463fab3b2132a23', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86837) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 13:23:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9f06950c-9177-4f4c-9eba-56c8b062f51f tempest-CreateVolumesFromImageTest-1334001682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9f06950c-9177-4f4c-9eba-56c8b062f51f tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9f06950c-9177-4f4c-9eba-56c8b062f51f tempest-CreateVolumesFromImageTest-1334001682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:23:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-9f06950c-9177-4f4c-9eba-56c8b062f51f tempest-CreateVolumesFromImageTest-1334001682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:23:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-9f06950c-9177-4f4c-9eba-56c8b062f51f tempest-CreateVolumesFromImageTest-1334001682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9f06950c-9177-4f4c-9eba-56c8b062f51f tempest-CreateVolumesFromImageTest-1334001682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd954ca-d5b8-40b9-8c6b-48db8bf6f16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38061a22-27e4-41c0-9330-84a6706d9732', 'volume_size': 1, 'image_id': '705ca459-7846-4c07-a59e-40369940b27c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/705ca459-7846-4c07-a59e-40369940b27c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6b43b4ca9759f98f9463fab3b2132a23', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '033619cdbf9c4e04a7a85c2f8a196da9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '907c744aa94ae41fc0bd59a7f9f6532382d796418ad5e82e1ad260e4c0288310e113069e1e24e73bb0ca3048b142b1a8c5a95b7f7253799fc4a4ea351f2fd0b6', 'id': '705ca459-7846-4c07-a59e-40369940b27c', 'created_at': datetime.datetime(2026, 7, 3, 11, 23, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 11, 23, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/705ca459-7846-4c07-a59e-40369940b27c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7aa53be4bd70>}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28b5d76-e865-40e1-9485-9bc5b09ffa5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:44 devstack sudo[106741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:23:44 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:44 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Volume volume-38061a22-27e4-41c0-9330-84a6706d9732 (38061a22-27e4-41c0-9330-84a6706d9732): created successfully
Jul 03 13:23:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28b5d76-e865-40e1-9485-9bc5b09ffa5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:44 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Flow 'volume_create_manager' (e0fdb5ca-cfa6-44cf-99c6-03575c92f6a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:23:44 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-746c46cd-d1c5-4021-90e2-38d78ec44166 tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Created volume successfully.
Jul 03 13:23:45 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a1e99baf-83d9-4397-98fe-d93a8a6efdb1 tempest-VolumeImageDependencyTests-409777805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8" returned: 0 in 1.116s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a1e99baf-83d9-4397-98fe-d93a8a6efdb1 tempest-VolumeImageDependencyTests-409777805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-28584cb8-9938-4fcd-aebc-509a1c09c72d tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Acquiring lock "cinder-38061a22-27e4-41c0-9330-84a6706d9732-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:23:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-28584cb8-9938-4fcd-aebc-509a1c09c72d tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Lock "cinder-38061a22-27e4-41c0-9330-84a6706d9732-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:23:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-28584cb8-9938-4fcd-aebc-509a1c09c72d tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Acquiring lock "cinder-quobyte-38061a22-27e4-41c0-9330-84a6706d9732" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:23:45 devstack sudo[106747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8
Jul 03 13:23:45 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-28584cb8-9938-4fcd-aebc-509a1c09c72d tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Lock "cinder-quobyte-38061a22-27e4-41c0-9330-84a6706d9732" acquired by "delete_volume" :: waited 0.027s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:23:45 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-973a728e-c380-4d49-9cea-85832a8eb521 tempest-ProjectReaderTests-1717421477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65.0f13b327-c84e-4ff7-a729-430c00a5d7b7" returned: 0 in 1.191s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:45 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-973a728e-c380-4d49-9cea-85832a8eb521 tempest-ProjectReaderTests-1717421477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:23:45 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ccd3a6-e612-4a21-99b1-67abfc84a31b]: (4, 'raw') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:23:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-28584cb8-9938-4fcd-aebc-509a1c09c72d tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:45 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cbff08-48e5-4fee-bc6f-0bea9b29e66b]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:23:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-973a728e-c380-4d49-9cea-85832a8eb521 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:45 devstack sudo[106751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65
Jul 03 13:23:45 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:45 devstack sudo[106750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732
Jul 03 13:23:45 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:45 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9f06950c-9177-4f4c-9eba-56c8b062f51f tempest-CreateVolumesFromImageTest-1334001682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.170s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:45 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-9f06950c-9177-4f4c-9eba-56c8b062f51f tempest-CreateVolumesFromImageTest-1334001682 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:23:45 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-9f06950c-9177-4f4c-9eba-56c8b062f51f tempest-CreateVolumesFromImageTest-1334001682 None] Deleted volume successfully.
Jul 03 13:23:46 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9f06950c-9177-4f4c-9eba-56c8b062f51f tempest-CreateVolumesFromImageTest-1334001682 None] Lock "cinder-d7ceaf9c-1997-42d9-bf88-6754aa61b018-delete_volume" released by "delete_volume" :: held 3.393s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:23:46 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a1e99baf-83d9-4397-98fe-d93a8a6efdb1 tempest-VolumeImageDependencyTests-409777805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8" returned: 1 in 1.042s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a1e99baf-83d9-4397-98fe-d93a8a6efdb1 tempest-VolumeImageDependencyTests-409777805 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:23:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a1e99baf-83d9-4397-98fe-d93a8a6efdb1 tempest-VolumeImageDependencyTests-409777805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:46 devstack sudo[106760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8
Jul 03 13:23:46 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:46 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-973a728e-c380-4d49-9cea-85832a8eb521 tempest-ProjectReaderTests-1717421477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65" returned: 0 in 0.999s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-973a728e-c380-4d49-9cea-85832a8eb521 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65.0f13b327-c84e-4ff7-a729-430c00a5d7b7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:46 devstack sudo[106764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65.0f13b327-c84e-4ff7-a729-430c00a5d7b7
Jul 03 13:23:46 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:46 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-28584cb8-9938-4fcd-aebc-509a1c09c72d tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732" returned: 0 in 1.258s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-28584cb8-9938-4fcd-aebc-509a1c09c72d tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:46 devstack sudo[106768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732
Jul 03 13:23:46 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:46 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a1e99baf-83d9-4397-98fe-d93a8a6efdb1 tempest-VolumeImageDependencyTests-409777805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8" returned: 0 in 0.841s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:46 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a1e99baf-83d9-4397-98fe-d93a8a6efdb1 tempest-VolumeImageDependencyTests-409777805 None] Lock "cinder-quobyte-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8" released by "delete_volume" :: held 3.130s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:23:47 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-a1e99baf-83d9-4397-98fe-d93a8a6efdb1 tempest-VolumeImageDependencyTests-409777805 None] Created reservations ['e43a0f14-d2ef-4b3a-a24a-a136238d8cb2', '643a5bf5-632c-4267-989f-a2ca9f209c92', 'c179b8a6-1fb4-4b25-80f7-041c96a49e4e', '9bef344e-8ca5-4eb3-859f-0df57e572e25'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:23:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a1e99baf-83d9-4397-98fe-d93a8a6efdb1 tempest-VolumeImageDependencyTests-409777805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a1e99baf-83d9-4397-98fe-d93a8a6efdb1 tempest-VolumeImageDependencyTests-409777805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:47 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a1e99baf-83d9-4397-98fe-d93a8a6efdb1 tempest-VolumeImageDependencyTests-409777805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:23:47 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a1e99baf-83d9-4397-98fe-d93a8a6efdb1 tempest-VolumeImageDependencyTests-409777805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:23:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a1e99baf-83d9-4397-98fe-d93a8a6efdb1 tempest-VolumeImageDependencyTests-409777805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a1e99baf-83d9-4397-98fe-d93a8a6efdb1 tempest-VolumeImageDependencyTests-409777805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:47 devstack sudo[106776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:23:47 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:47 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-973a728e-c380-4d49-9cea-85832a8eb521 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65.0f13b327-c84e-4ff7-a729-430c00a5d7b7" returned: 0 in 1.121s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-973a728e-c380-4d49-9cea-85832a8eb521 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65.0f13b327-c84e-4ff7-a729-430c00a5d7b7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:47 devstack sudo[106779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65.0f13b327-c84e-4ff7-a729-430c00a5d7b7
Jul 03 13:23:47 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:47 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-28584cb8-9938-4fcd-aebc-509a1c09c72d tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732" returned: 1 in 1.066s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-28584cb8-9938-4fcd-aebc-509a1c09c72d tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732' failed. Not Retrying. {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 13:23:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-28584cb8-9938-4fcd-aebc-509a1c09c72d tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:47 devstack sudo[106783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732
Jul 03 13:23:47 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:48 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a1e99baf-83d9-4397-98fe-d93a8a6efdb1 tempest-VolumeImageDependencyTests-409777805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.918s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:48 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-a1e99baf-83d9-4397-98fe-d93a8a6efdb1 tempest-VolumeImageDependencyTests-409777805 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:23:48 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-a1e99baf-83d9-4397-98fe-d93a8a6efdb1 tempest-VolumeImageDependencyTests-409777805 None] Deleted volume successfully.
Jul 03 13:23:48 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a1e99baf-83d9-4397-98fe-d93a8a6efdb1 tempest-VolumeImageDependencyTests-409777805 None] Lock "cinder-6bc4e71d-812b-48fc-9dc1-0b75cb54fcb8-delete_volume" released by "delete_volume" :: held 4.530s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:23:48 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-973a728e-c380-4d49-9cea-85832a8eb521 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65.0f13b327-c84e-4ff7-a729-430c00a5d7b7" returned: 0 in 0.844s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:48 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-973a728e-c380-4d49-9cea-85832a8eb521 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-0f13b327-c84e-4ff7-a729-430c00a5d7b7" released by "_delete_snapshot" :: held 4.362s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:23:48 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-973a728e-c380-4d49-9cea-85832a8eb521 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65" released by "delete_snapshot" :: held 4.407s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:23:48 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-973a728e-c380-4d49-9cea-85832a8eb521 tempest-ProjectReaderTests-1717421477 None] Created reservations ['fd2a482c-c87f-4add-9ad3-1a806d040486', '4cc3f9ac-3946-4569-a015-7cd20984dacc', '4be60c18-9b79-406a-9200-413ff6886106', 'a5b3974b-9948-4ccb-b888-6ceef3c8db65'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:23:48 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-28584cb8-9938-4fcd-aebc-509a1c09c72d tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-38061a22-27e4-41c0-9330-84a6706d9732" returned: 0 in 0.849s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:48 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-28584cb8-9938-4fcd-aebc-509a1c09c72d tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Lock "cinder-quobyte-38061a22-27e4-41c0-9330-84a6706d9732" released by "delete_volume" :: held 3.288s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:23:48 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-973a728e-c380-4d49-9cea-85832a8eb521 tempest-ProjectReaderTests-1717421477 None] Delete snapshot completed successfully.
Jul 03 13:23:48 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-973a728e-c380-4d49-9cea-85832a8eb521 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-0f13b327-c84e-4ff7-a729-430c00a5d7b7-delete_snapshot" released by "delete_snapshot" :: held 4.662s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:23:48 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-28584cb8-9938-4fcd-aebc-509a1c09c72d tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Created reservations ['0a239e35-79db-4248-b065-d7b30e7acb3e', 'a5e25902-83e3-43f2-9115-65de10136e0e', '0d225bea-4b87-40db-8938-fb1f86cf994f', '967c0ca6-bdd2-4c3c-88bd-e1348b17d674'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:23:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-28584cb8-9938-4fcd-aebc-509a1c09c72d tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-28584cb8-9938-4fcd-aebc-509a1c09c72d tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:48 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-28584cb8-9938-4fcd-aebc-509a1c09c72d tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:23:48 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-28584cb8-9938-4fcd-aebc-509a1c09c72d tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:23:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-28584cb8-9938-4fcd-aebc-509a1c09c72d tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-28584cb8-9938-4fcd-aebc-509a1c09c72d tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:48 devstack sudo[106788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:23:48 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Flow 'volume_create_manager' (76947b71-d65b-4122-b20d-c6c10d0cff26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0ee2d8-c0e4-4694-b120-13ce4c6c8c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-12c34d8b-f17b-4e43-a3a1-5cdb15a2dd3d tempest-ProjectReaderTests-1717421477 None] Acquiring lock "cinder-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0ee2d8-c0e4-4694-b120-13ce4c6c8c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1563741799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b4076a-9544-4c92-8c1a-153afc29c8fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cdd1a2cb6e7438fab43841f46d0df46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:23:49Z,use_quota=True,user_id='bc8e41a4b4c8428d8ac825eb38312c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6309795c-5ef3-425f-801e-7ba191504dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6309795c-5ef3-425f-801e-7ba191504dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89e435a-877a-4d57-b89a-cf1e2e9ce776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89e435a-877a-4d57-b89a-cf1e2e9ce776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4b4076a-9544-4c92-8c1a-153afc29c8fe', 'volume_name': 'volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0f9a08-c3b5-4057-9a63-451eee1f6f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0f9a08-c3b5-4057-9a63-451eee1f6f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3836d88c-8af3-412a-87d2-5a539760247c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:49 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Volume e4b4076a-9544-4c92-8c1a-153afc29c8fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe', 'volume_size': 1}
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1563741799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b4076a-9544-4c92-8c1a-153afc29c8fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cdd1a2cb6e7438fab43841f46d0df46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:23:49Z,use_quota=True,user_id='bc8e41a4b4c8428d8ac825eb38312c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Creating volume e4b4076a-9544-4c92-8c1a-153afc29c8fe {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:23:49 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-12c34d8b-f17b-4e43-a3a1-5cdb15a2dd3d tempest-ProjectReaderTests-1717421477 None] Lock "cinder-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65-delete_volume" acquired by "delete_volume" :: waited 0.128s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:23:49 devstack sudo[106791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe 1073741824
Jul 03 13:23:49 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:49 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-28584cb8-9938-4fcd-aebc-509a1c09c72d tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.807s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-28584cb8-9938-4fcd-aebc-509a1c09c72d tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:23:49 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-28584cb8-9938-4fcd-aebc-509a1c09c72d tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Deleted volume successfully.
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-12c34d8b-f17b-4e43-a3a1-5cdb15a2dd3d tempest-ProjectReaderTests-1717421477 None] Acquiring lock "cinder-quobyte-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-12c34d8b-f17b-4e43-a3a1-5cdb15a2dd3d tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65" acquired by "delete_volume" :: waited 0.028s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-28584cb8-9938-4fcd-aebc-509a1c09c72d tempest-VolumeAndVolumeTypeFromImageTest-707843541 None] Lock "cinder-38061a22-27e4-41c0-9330-84a6706d9732-delete_volume" released by "delete_volume" :: held 4.466s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[02be19b3-aa40-4331-b1d6-8b39bfa6a25f]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:23:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-12c34d8b-f17b-4e43-a3a1-5cdb15a2dd3d tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:49 devstack sudo[106793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65
Jul 03 13:23:49 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:50 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-12c34d8b-f17b-4e43-a3a1-5cdb15a2dd3d tempest-ProjectReaderTests-1717421477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65" returned: 0 in 1.054s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-12c34d8b-f17b-4e43-a3a1-5cdb15a2dd3d tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:50 devstack sudo[106802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65
Jul 03 13:23:50 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:50 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe 1073741824" returned: 0 in 1.339s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:50 devstack sudo[106804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe
Jul 03 13:23:50 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:51 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe" returned: 0 in 0.797s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] <== create_volume: return (2196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:23:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.199s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3836d88c-8af3-412a-87d2-5a539760247c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f940380f-8693-4323-870f-7e9f603c4eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:51 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Volume volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe (e4b4076a-9544-4c92-8c1a-153afc29c8fe): created successfully
Jul 03 13:23:51 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f940380f-8693-4323-870f-7e9f603c4eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Flow 'volume_create_manager' (76947b71-d65b-4122-b20d-c6c10d0cff26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:23:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-12c34d8b-f17b-4e43-a3a1-5cdb15a2dd3d tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65" returned: 0 in 1.017s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:51 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-12c34d8b-f17b-4e43-a3a1-5cdb15a2dd3d tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65" released by "delete_volume" :: held 2.178s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:23:51 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-a7860e1a-67f5-4f76-b19a-1d2fde5bb3ed tempest-VolumeDependencyTests-1287859259 None] Created volume successfully.
Jul 03 13:23:51 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-12c34d8b-f17b-4e43-a3a1-5cdb15a2dd3d tempest-ProjectReaderTests-1717421477 None] Created reservations ['897539ce-38cd-4d9d-b4f3-7d8586b94ee3', 'f487d83f-f307-401f-b0dc-f24227cd6072', 'ee494a75-a94b-4013-a7bb-d9d586efed6f', '2191206c-9d00-48b7-b368-78ded84340c9'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:23:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-12c34d8b-f17b-4e43-a3a1-5cdb15a2dd3d tempest-ProjectReaderTests-1717421477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-12c34d8b-f17b-4e43-a3a1-5cdb15a2dd3d tempest-ProjectReaderTests-1717421477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-12c34d8b-f17b-4e43-a3a1-5cdb15a2dd3d tempest-ProjectReaderTests-1717421477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:23:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-12c34d8b-f17b-4e43-a3a1-5cdb15a2dd3d tempest-ProjectReaderTests-1717421477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:23:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-12c34d8b-f17b-4e43-a3a1-5cdb15a2dd3d tempest-ProjectReaderTests-1717421477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-12c34d8b-f17b-4e43-a3a1-5cdb15a2dd3d tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:51 devstack sudo[106808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:23:51 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:52 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:23:52 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Flow 'volume_create_manager' (5f94b78b-6ac0-4ceb-92bf-945293177774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:23:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0057ac87-09b9-4a5d-b98f-8ff3abfb081f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-12c34d8b-f17b-4e43-a3a1-5cdb15a2dd3d tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.848s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:52 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-12c34d8b-f17b-4e43-a3a1-5cdb15a2dd3d tempest-ProjectReaderTests-1717421477 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:23:52 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-12c34d8b-f17b-4e43-a3a1-5cdb15a2dd3d tempest-ProjectReaderTests-1717421477 None] Deleted volume successfully.
Jul 03 13:23:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0057ac87-09b9-4a5d-b98f-8ff3abfb081f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a5a40b-9984-4b10-ab7c-48f9ccce130d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84798a4e6c674ef0a63dd18a2e390679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:23:53Z,use_quota=True,user_id='8d5dd3368ade45538a5eba336d6f525d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33416157-e1a0-40f0-b93e-77e08155b0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33416157-e1a0-40f0-b93e-77e08155b0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (700ef6cb-ecd1-448d-9b10-20e49efd388f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (700ef6cb-ecd1-448d-9b10-20e49efd388f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1a5a40b-9984-4b10-ab7c-48f9ccce130d', 'volume_name': 'volume-e1a5a40b-9984-4b10-ab7c-48f9ccce130d', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7814ef6-39e3-45d7-9c81-009872415e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7814ef6-39e3-45d7-9c81-009872415e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5fc9440-59be-482b-84f8-67c3f7c9cab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:52 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Volume e1a5a40b-9984-4b10-ab7c-48f9ccce130d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1a5a40b-9984-4b10-ab7c-48f9ccce130d', 'volume_size': 1}
Jul 03 13:23:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a5a40b-9984-4b10-ab7c-48f9ccce130d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84798a4e6c674ef0a63dd18a2e390679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:23:53Z,use_quota=True,user_id='8d5dd3368ade45538a5eba336d6f525d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:23:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Creating volume e1a5a40b-9984-4b10-ab7c-48f9ccce130d {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:23:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:23:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:23:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:23:52 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:23:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a5a40b-9984-4b10-ab7c-48f9ccce130d 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:52 devstack sudo[106811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a5a40b-9984-4b10-ab7c-48f9ccce130d 1073741824
Jul 03 13:23:52 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:52 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-12c34d8b-f17b-4e43-a3a1-5cdb15a2dd3d tempest-ProjectReaderTests-1717421477 None] Lock "cinder-f7fd6dfc-df6f-4e66-8fc5-9953a4e4ec65-delete_volume" released by "delete_volume" :: held 3.406s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:23:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-456c040b-af5a-4378-81e2-e9c2e551c6c0 tempest-VolumeDependencyTests-1287859259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:53 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:23:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Flow 'volume_create_manager' (00f2ae0f-8e04-4e04-a8da-abf86a6c4ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:23:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20cefb9e-65b9-4c6a-b960-e2449e9a6384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20cefb9e-65b9-4c6a-b960-e2449e9a6384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-476190119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9b9895e6094ba491a40e642c6a03b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:23:53Z,use_quota=True,user_id='8fca7bfb7d5b44a6a8b3f9e7153bf18a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69fc1017-a455-466f-a052-b82107e1236b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69fc1017-a455-466f-a052-b82107e1236b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3462136d-1393-4c96-8c15-12a1e6d8097b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3462136d-1393-4c96-8c15-12a1e6d8097b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0', 'volume_name': 'volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3e5d65-7413-44db-9516-a8973eea88ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3e5d65-7413-44db-9516-a8973eea88ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:53 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac4cc96-dd98-4dc4-944b-6df1a2698829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:53 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Volume bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0', 'volume_size': 1}
Jul 03 13:23:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:53 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a5a40b-9984-4b10-ab7c-48f9ccce130d 1073741824" returned: 0 in 0.972s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a5a40b-9984-4b10-ab7c-48f9ccce130d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:53 devstack sudo[106818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a5a40b-9984-4b10-ab7c-48f9ccce130d
Jul 03 13:23:53 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:54 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a5a40b-9984-4b10-ab7c-48f9ccce130d" returned: 0 in 0.707s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:54 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:23:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-456c040b-af5a-4378-81e2-e9c2e551c6c0 tempest-VolumeDependencyTests-1287859259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.662s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5fc9440-59be-482b-84f8-67c3f7c9cab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1a5a40b-9984-4b10-ab7c-48f9ccce130d', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (845d23f5-e795-4b0f-8462-b4e2c2c46339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:54 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-456c040b-af5a-4378-81e2-e9c2e551c6c0 tempest-VolumeDependencyTests-1287859259 None] Creating offline snapshot 414fb6c8-2071-4c78-9d27-71640a510bbe of volume e4b4076a-9544-4c92-8c1a-153afc29c8fe {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:23:54 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Volume volume-e1a5a40b-9984-4b10-ab7c-48f9ccce130d (e1a5a40b-9984-4b10-ab7c-48f9ccce130d): created successfully
Jul 03 13:23:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (845d23f5-e795-4b0f-8462-b4e2c2c46339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Flow 'volume_create_manager' (5f94b78b-6ac0-4ceb-92bf-945293177774) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:23:54 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ed3c81-1a44-4a9c-9b53-a61061841000]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:23:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-456c040b-af5a-4378-81e2-e9c2e551c6c0 tempest-VolumeDependencyTests-1287859259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:54 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-31109531-e360-4981-be50-8e5a3f15d700 tempest-CinderUnicodeTest-1438954782 None] Created volume successfully.
Jul 03 13:23:54 devstack sudo[106821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe
Jul 03 13:23:54 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:55 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:55 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:23:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Flow 'volume_create_manager' (172e8ba4-7ec5-4251-b852-c5521ed5ed57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:23:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b84b56-d2b0-4984-b5c7-0ac1fc5e9597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-456c040b-af5a-4378-81e2-e9c2e551c6c0 tempest-VolumeDependencyTests-1287859259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe" returned: 0 in 0.889s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-456c040b-af5a-4378-81e2-e9c2e551c6c0 tempest-VolumeDependencyTests-1287859259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.414fb6c8-2071-4c78-9d27-71640a510bbe 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b84b56-d2b0-4984-b5c7-0ac1fc5e9597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-604942527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=915dc63a-5622-4c54-b7f9-cc2e4cbc1b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='808f40c3de04432abd497101058ba5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:23:55Z,use_quota=True,user_id='459a1deef2fe4893b063a55a00d1ccc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:55 devstack sudo[106826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.414fb6c8-2071-4c78-9d27-71640a510bbe 1G
Jul 03 13:23:55 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1950c29-4946-4793-a0e1-09ffcf84cbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1950c29-4946-4793-a0e1-09ffcf84cbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da7ea9a5-03fd-4ed1-9289-96c3742c9089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da7ea9a5-03fd-4ed1-9289-96c3742c9089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '915dc63a-5622-4c54-b7f9-cc2e4cbc1b78', 'volume_name': 'volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07b71201-6e0f-4002-a8dd-6c94a2246ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07b71201-6e0f-4002-a8dd-6c94a2246ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:55 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35b67904-11f0-4770-8381-763d7268b741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:55 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Volume 915dc63a-5622-4c54-b7f9-cc2e4cbc1b78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78', 'volume_size': 1}
Jul 03 13:23:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:56 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:23:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Flow 'volume_create_manager' (901f736f-e531-446e-bc5c-016bb317fac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:23:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d99c5f5a-4ff7-418d-92df-ba3e0ba8975a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d99c5f5a-4ff7-418d-92df-ba3e0ba8975a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:23:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1540631519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27e7e369-bb93-45d0-9a80-305f72d65c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84798a4e6c674ef0a63dd18a2e390679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:23:56Z,use_quota=True,user_id='8d5dd3368ade45538a5eba336d6f525d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25bec987-ebfb-4f20-8aac-eb6bd4d17155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25bec987-ebfb-4f20-8aac-eb6bd4d17155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27dc2c94-8232-4d3c-9738-65bc651d752b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27dc2c94-8232-4d3c-9738-65bc651d752b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27e7e369-bb93-45d0-9a80-305f72d65c22', 'volume_name': 'volume-27e7e369-bb93-45d0-9a80-305f72d65c22', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24393038-be2e-46a7-a491-89a506e67935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24393038-be2e-46a7-a491-89a506e67935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:23:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b34484-315e-48e7-9eb3-7b2b8de6e118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:23:56 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Volume 27e7e369-bb93-45d0-9a80-305f72d65c22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27e7e369-bb93-45d0-9a80-305f72d65c22', 'volume_size': 1}
Jul 03 13:23:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:56 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-456c040b-af5a-4378-81e2-e9c2e551c6c0 tempest-VolumeDependencyTests-1287859259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.414fb6c8-2071-4c78-9d27-71640a510bbe 1G" returned: 0 in 0.926s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-456c040b-af5a-4378-81e2-e9c2e551c6c0 tempest-VolumeDependencyTests-1287859259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.414fb6c8-2071-4c78-9d27-71640a510bbe {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:56 devstack sudo[106832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.414fb6c8-2071-4c78-9d27-71640a510bbe
Jul 03 13:23:56 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:57 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-456c040b-af5a-4378-81e2-e9c2e551c6c0 tempest-VolumeDependencyTests-1287859259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.414fb6c8-2071-4c78-9d27-71640a510bbe" returned: 0 in 0.741s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:57 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-456c040b-af5a-4378-81e2-e9c2e551c6c0 tempest-VolumeDependencyTests-1287859259 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.414fb6c8-2071-4c78-9d27-71640a510bbe is being set with open permissions: ugo+rw
Jul 03 13:23:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-456c040b-af5a-4378-81e2-e9c2e551c6c0 tempest-VolumeDependencyTests-1287859259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.414fb6c8-2071-4c78-9d27-71640a510bbe {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:57 devstack sudo[106837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.414fb6c8-2071-4c78-9d27-71640a510bbe
Jul 03 13:23:57 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:57 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-456c040b-af5a-4378-81e2-e9c2e551c6c0 tempest-VolumeDependencyTests-1287859259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.414fb6c8-2071-4c78-9d27-71640a510bbe" returned: 0 in 0.670s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-456c040b-af5a-4378-81e2-e9c2e551c6c0 tempest-VolumeDependencyTests-1287859259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:57 devstack sudo[106841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.info
Jul 03 13:23:57 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:58 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-456c040b-af5a-4378-81e2-e9c2e551c6c0 tempest-VolumeDependencyTests-1287859259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.info" returned: 0 in 0.680s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:58 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-456c040b-af5a-4378-81e2-e9c2e551c6c0 tempest-VolumeDependencyTests-1287859259 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.info is being set with open permissions: ugo+rw
Jul 03 13:23:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-456c040b-af5a-4378-81e2-e9c2e551c6c0 tempest-VolumeDependencyTests-1287859259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:58 devstack sudo[106844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.info
Jul 03 13:23:58 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:59 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root
Jul 03 13:23:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-456c040b-af5a-4378-81e2-e9c2e551c6c0 tempest-VolumeDependencyTests-1287859259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.info" returned: 0 in 0.672s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:23:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-456c040b-af5a-4378-81e2-e9c2e551c6c0 tempest-VolumeDependencyTests-1287859259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.701s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.853s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-476190119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9b9895e6094ba491a40e642c6a03b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:23:53Z,use_quota=True,user_id='8fca7bfb7d5b44a6a8b3f9e7153bf18a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:23:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Creating volume bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:23:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:23:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:23:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:23:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:23:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:23:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:23:59 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:23:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:23:59 devstack sudo[106847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0 1073741824
Jul 03 13:23:59 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:23:59 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-456c040b-af5a-4378-81e2-e9c2e551c6c0 tempest-VolumeDependencyTests-1287859259 None] Create snapshot completed successfully
Jul 03 13:24:00 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0 1073741824" returned: 0 in 0.871s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:00 devstack sudo[106852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0
Jul 03 13:24:00 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Flow 'volume_create_manager' (c5d09edd-ba6a-446c-8c58-8d30f8242a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c22940-2cf0-4dc8-a3e7-2388867bcd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c22940-2cf0-4dc8-a3e7-2388867bcd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-414064501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e56fb1ba-b154-490a-9219-f086a8eec7f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cdd1a2cb6e7438fab43841f46d0df46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=414fb6c8-2071-4c78-9d27-71640a510bbe,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:24:01Z,use_quota=True,user_id='bc8e41a4b4c8428d8ac825eb38312c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47340994-b610-480b-930c-7fbc210788a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47340994-b610-480b-930c-7fbc210788a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d748406-b853-4482-b4f0-f492068850fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d748406-b853-4482-b4f0-f492068850fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e56fb1ba-b154-490a-9219-f086a8eec7f4', 'volume_name': 'volume-e56fb1ba-b154-490a-9219-f086a8eec7f4', 'volume_size': 1, 'snapshot_id': '414fb6c8-2071-4c78-9d27-71640a510bbe'}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e6b1cf-3e48-4018-bf80-796c0ef76ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e6b1cf-3e48-4018-bf80-796c0ef76ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ec9a37-d905-4b87-a42e-ab5421a3ef4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:00 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Volume e56fb1ba-b154-490a-9219-f086a8eec7f4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e56fb1ba-b154-490a-9219-f086a8eec7f4', 'volume_size': 1, 'snapshot_id': '414fb6c8-2071-4c78-9d27-71640a510bbe'}
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:00 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0" returned: 0 in 0.744s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.337s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-604942527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=915dc63a-5622-4c54-b7f9-cc2e4cbc1b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='808f40c3de04432abd497101058ba5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:23:55Z,use_quota=True,user_id='459a1deef2fe4893b063a55a00d1ccc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Creating volume 915dc63a-5622-4c54-b7f9-cc2e4cbc1b78 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:24:00 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:00 devstack sudo[106857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78 1073741824
Jul 03 13:24:00 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac4cc96-dd98-4dc4-944b-6df1a2698829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e9e1214-3f12-4a3e-95d4-a3bb315a3ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:00 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Volume volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0 (bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0): created successfully
Jul 03 13:24:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e9e1214-3f12-4a3e-95d4-a3bb315a3ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:01 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Flow 'volume_create_manager' (00f2ae0f-8e04-4e04-a8da-abf86a6c4ddd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:24:01 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-cfab8226-b133-48c7-a1a6-38a58442d6d9 tempest-ProjectReaderTests-1717421477 None] Created volume successfully.
Jul 03 13:24:01 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78 1073741824" returned: 0 in 0.868s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:01 devstack sudo[106862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78
Jul 03 13:24:01 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c1db3d8c-de9e-411c-b91a-f105ef06a1e2 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:02 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78" returned: 0 in 0.684s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:24:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.091s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:23:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1540631519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27e7e369-bb93-45d0-9a80-305f72d65c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84798a4e6c674ef0a63dd18a2e390679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:23:56Z,use_quota=True,user_id='8d5dd3368ade45538a5eba336d6f525d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:24:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Creating volume 27e7e369-bb93-45d0-9a80-305f72d65c22 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:24:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:24:02 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:24:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:02 devstack sudo[106865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22 1073741824
Jul 03 13:24:02 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35b67904-11f0-4770-8381-763d7268b741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4deafdb5-36c2-499c-aacf-7f9adde749f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:02 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Volume volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78 (915dc63a-5622-4c54-b7f9-cc2e4cbc1b78): created successfully
Jul 03 13:24:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4deafdb5-36c2-499c-aacf-7f9adde749f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Flow 'volume_create_manager' (172e8ba4-7ec5-4251-b852-c5521ed5ed57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:24:02 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-0a76fbab-7f4c-4729-8262-4ea8b8886c44 tempest-CreateVolumesFromSnapshotTest-173971802 None] Created volume successfully.
Jul 03 13:24:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-dc6beb3b-15fa-403e-aae8-5aa7479c2afe tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:03 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22 1073741824" returned: 0 in 0.933s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:03 devstack sudo[106872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22
Jul 03 13:24:03 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:04 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22" returned: 0 in 0.711s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:24:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.462s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Acquiring lock "cinder-quobyte-414fb6c8-2071-4c78-9d27-71640a510bbe-e56fb1ba-b154-490a-9219-f086a8eec7f4" by "_create_volume_from_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b34484-315e-48e7-9eb3-7b2b8de6e118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27e7e369-bb93-45d0-9a80-305f72d65c22', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf2b3a57-3207-4966-b552-1cae433ab2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Lock "cinder-quobyte-414fb6c8-2071-4c78-9d27-71640a510bbe-e56fb1ba-b154-490a-9219-f086a8eec7f4" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Creating volume e56fb1ba-b154-490a-9219-f086a8eec7f4 from snapshot 414fb6c8-2071-4c78-9d27-71640a510bbe {{(pid=86837) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 13:24:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:24:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Acquiring lock "cinder-quobyte-e56fb1ba-b154-490a-9219-f086a8eec7f4" by "_copy_volume_from_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:04 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Volume volume-27e7e369-bb93-45d0-9a80-305f72d65c22 (27e7e369-bb93-45d0-9a80-305f72d65c22): created successfully
Jul 03 13:24:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf2b3a57-3207-4966-b552-1cae433ab2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Flow 'volume_create_manager' (901f736f-e531-446e-bc5c-016bb317fac6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:24:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Lock "cinder-quobyte-e56fb1ba-b154-490a-9219-f086a8eec7f4" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] snapshot: 414fb6c8-2071-4c78-9d27-71640a510bbe, volume: e56fb1ba-b154-490a-9219-f086a8eec7f4,  {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 13:24:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:04 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-a764b627-412c-4429-9cd4-72d0d2f6ac95 tempest-CinderUnicodeTest-1438954782 None] Created volume successfully.
Jul 03 13:24:04 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e00fdb-df12-4b7b-9f2d-803ef7b7665d]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.414fb6c8-2071-4c78-9d27-71640a510bbe {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:04 devstack sudo[106875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.414fb6c8-2071-4c78-9d27-71640a510bbe
Jul 03 13:24:04 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:05 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.414fb6c8-2071-4c78-9d27-71640a510bbe" returned: 0 in 0.768s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:05 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:24:05 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 13:24:05 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Creating direct copy from snapshot {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 13:24:05 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[357b8191-31f2-4fa2-9203-ef832e3c776b]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-656124b9-30de-442c-a53f-1e67d3271c3f tempest-CinderUnicodeTest-1438954782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:05 devstack sudo[106881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe
Jul 03 13:24:05 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:06 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe" returned: 0 in 0.878s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:06 devstack cinder-volume[86837]: DEBUG cinder.utils [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Path /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e56fb1ba-b154-490a-9219-f086a8eec7f4 not found in is_blk_device check {{(pid=86837) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 13:24:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e56fb1ba-b154-490a-9219-f086a8eec7f4 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:06 devstack sudo[106887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e56fb1ba-b154-490a-9219-f086a8eec7f4
Jul 03 13:24:06 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:10 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e56fb1ba-b154-490a-9219-f086a8eec7f4" returned: 0 in 4.425s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:10 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b4ddf3-786f-4f3d-9242-d5cc014eb525]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:10 devstack sudo[106900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe
Jul 03 13:24:10 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:11 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe" returned: 0 in 0.920s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:11 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe, size 1024.00 MB, duration 4.43 sec, destination /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e56fb1ba-b154-490a-9219-f086a8eec7f4 {{(pid=86837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 13:24:11 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Converted 1024.00 MB image at 231.33 MB/s
Jul 03 13:24:11 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e56fb1ba-b154-490a-9219-f086a8eec7f4 is being set with open permissions: ugo+rw
Jul 03 13:24:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e56fb1ba-b154-490a-9219-f086a8eec7f4 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:11 devstack sudo[106905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e56fb1ba-b154-490a-9219-f086a8eec7f4
Jul 03 13:24:11 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:12 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e56fb1ba-b154-490a-9219-f086a8eec7f4" returned: 0 in 0.629s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Lock "cinder-quobyte-e56fb1ba-b154-490a-9219-f086a8eec7f4" released by "_copy_volume_from_snapshot" :: held 7.730s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Lock "cinder-quobyte-414fb6c8-2071-4c78-9d27-71640a510bbe-e56fb1ba-b154-490a-9219-f086a8eec7f4" released by "_create_volume_from_snapshot" :: held 7.772s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.806s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c1db3d8c-de9e-411c-b91a-f105ef06a1e2 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.025s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:12 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-c1db3d8c-de9e-411c-b91a-f105ef06a1e2 tempest-ProjectReaderTests-1717421477 None] Creating offline snapshot 86b5b95f-7d2d-492c-a0b3-bbe31a63f3dd of volume bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0 {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:24:12 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[766e1b7b-ac9a-4271-a017-b1fd286d9bed]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c1db3d8c-de9e-411c-b91a-f105ef06a1e2 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:12 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ec9a37-d905-4b87-a42e-ab5421a3ef4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e56fb1ba-b154-490a-9219-f086a8eec7f4', 'volume_size': 1, 'snapshot_id': '414fb6c8-2071-4c78-9d27-71640a510bbe'}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:12 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7476b621-da59-4c10-88a5-a54ff7315c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:12 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Volume volume-e56fb1ba-b154-490a-9219-f086a8eec7f4 (e56fb1ba-b154-490a-9219-f086a8eec7f4): created successfully
Jul 03 13:24:12 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7476b621-da59-4c10-88a5-a54ff7315c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:12 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Flow 'volume_create_manager' (c5d09edd-ba6a-446c-8c58-8d30f8242a74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:24:12 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-8e9aa20d-6fe3-4ccc-b449-596ca1482c0d tempest-VolumeDependencyTests-1287859259 None] Created volume successfully.
Jul 03 13:24:12 devstack sudo[106908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0
Jul 03 13:24:12 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e00e95a1-7a7f-48c8-81d1-0fed7d1f3028 tempest-VolumeDependencyTests-1287859259 None] Acquiring lock "cinder-414fb6c8-2071-4c78-9d27-71640a510bbe-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e00e95a1-7a7f-48c8-81d1-0fed7d1f3028 tempest-VolumeDependencyTests-1287859259 None] Lock "cinder-414fb6c8-2071-4c78-9d27-71640a510bbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e00e95a1-7a7f-48c8-81d1-0fed7d1f3028 tempest-VolumeDependencyTests-1287859259 None] Acquiring lock "cinder-quobyte-e4b4076a-9544-4c92-8c1a-153afc29c8fe" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e00e95a1-7a7f-48c8-81d1-0fed7d1f3028 tempest-VolumeDependencyTests-1287859259 None] Lock "cinder-quobyte-e4b4076a-9544-4c92-8c1a-153afc29c8fe" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e00e95a1-7a7f-48c8-81d1-0fed7d1f3028 tempest-VolumeDependencyTests-1287859259 None] Acquiring lock "cinder-quobyte-414fb6c8-2071-4c78-9d27-71640a510bbe" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e00e95a1-7a7f-48c8-81d1-0fed7d1f3028 tempest-VolumeDependencyTests-1287859259 None] Lock "cinder-quobyte-414fb6c8-2071-4c78-9d27-71640a510bbe" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:12 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-e00e95a1-7a7f-48c8-81d1-0fed7d1f3028 tempest-VolumeDependencyTests-1287859259 None] Deleting offline snapshot 414fb6c8-2071-4c78-9d27-71640a510bbe of volume e4b4076a-9544-4c92-8c1a-153afc29c8fe {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:24:12 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-e00e95a1-7a7f-48c8-81d1-0fed7d1f3028 tempest-VolumeDependencyTests-1287859259 None] snapshot_file for this snap is: volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.414fb6c8-2071-4c78-9d27-71640a510bbe {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:24:12 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8fc9ef-2df2-4df6-a949-da8a1f147efc]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e00e95a1-7a7f-48c8-81d1-0fed7d1f3028 tempest-VolumeDependencyTests-1287859259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.414fb6c8-2071-4c78-9d27-71640a510bbe {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:12 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c1db3d8c-de9e-411c-b91a-f105ef06a1e2 tempest-ProjectReaderTests-1717421477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0" returned: 0 in 0.760s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c1db3d8c-de9e-411c-b91a-f105ef06a1e2 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0.86b5b95f-7d2d-492c-a0b3-bbe31a63f3dd 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:12 devstack sudo[106913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.414fb6c8-2071-4c78-9d27-71640a510bbe
Jul 03 13:24:12 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:12 devstack sudo[106915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0.86b5b95f-7d2d-492c-a0b3-bbe31a63f3dd 1G
Jul 03 13:24:12 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:13 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e00e95a1-7a7f-48c8-81d1-0fed7d1f3028 tempest-VolumeDependencyTests-1287859259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.414fb6c8-2071-4c78-9d27-71640a510bbe" returned: 0 in 0.829s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:13 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-e00e95a1-7a7f-48c8-81d1-0fed7d1f3028 tempest-VolumeDependencyTests-1287859259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:24:13 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[675db4a1-6d47-485a-9f21-a04e8dd1f5cb]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e00e95a1-7a7f-48c8-81d1-0fed7d1f3028 tempest-VolumeDependencyTests-1287859259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:13 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c1db3d8c-de9e-411c-b91a-f105ef06a1e2 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0.86b5b95f-7d2d-492c-a0b3-bbe31a63f3dd 1G" returned: 0 in 0.835s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c1db3d8c-de9e-411c-b91a-f105ef06a1e2 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0.86b5b95f-7d2d-492c-a0b3-bbe31a63f3dd {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:13 devstack sudo[106926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0.86b5b95f-7d2d-492c-a0b3-bbe31a63f3dd
Jul 03 13:24:13 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:13 devstack sudo[106925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe
Jul 03 13:24:13 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:14 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e00e95a1-7a7f-48c8-81d1-0fed7d1f3028 tempest-VolumeDependencyTests-1287859259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe" returned: 0 in 0.792s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:14 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e00e95a1-7a7f-48c8-81d1-0fed7d1f3028 tempest-VolumeDependencyTests-1287859259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.414fb6c8-2071-4c78-9d27-71640a510bbe {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c1db3d8c-de9e-411c-b91a-f105ef06a1e2 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0.86b5b95f-7d2d-492c-a0b3-bbe31a63f3dd" returned: 0 in 0.713s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:14 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-c1db3d8c-de9e-411c-b91a-f105ef06a1e2 tempest-ProjectReaderTests-1717421477 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0.86b5b95f-7d2d-492c-a0b3-bbe31a63f3dd is being set with open permissions: ugo+rw
Jul 03 13:24:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c1db3d8c-de9e-411c-b91a-f105ef06a1e2 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0.86b5b95f-7d2d-492c-a0b3-bbe31a63f3dd {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:14 devstack sudo[106935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.414fb6c8-2071-4c78-9d27-71640a510bbe
Jul 03 13:24:14 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:14 devstack sudo[106936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0.86b5b95f-7d2d-492c-a0b3-bbe31a63f3dd
Jul 03 13:24:14 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:24:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:14 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c1db3d8c-de9e-411c-b91a-f105ef06a1e2 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0.86b5b95f-7d2d-492c-a0b3-bbe31a63f3dd" returned: 0 in 0.624s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:15 devstack sudo[106943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:24:15 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c1db3d8c-de9e-411c-b91a-f105ef06a1e2 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:15 devstack sudo[106946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0.info
Jul 03 13:24:15 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:15 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e00e95a1-7a7f-48c8-81d1-0fed7d1f3028 tempest-VolumeDependencyTests-1287859259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.414fb6c8-2071-4c78-9d27-71640a510bbe" returned: 0 in 0.834s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e00e95a1-7a7f-48c8-81d1-0fed7d1f3028 tempest-VolumeDependencyTests-1287859259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.414fb6c8-2071-4c78-9d27-71640a510bbe {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:15 devstack sudo[106948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.414fb6c8-2071-4c78-9d27-71640a510bbe
Jul 03 13:24:15 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:15 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.763s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:15 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:24:15 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:24:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 28 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:24:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>, <Thread(tpool_thread_0, started daemon 134850092431040)>, <Thread(tpool_thread_1, started daemon 134850084021952)>, <Thread(tpool_thread_2, started daemon 134850075612864)>, <Thread(tpool_thread_3, started daemon 134850067203776)>, <Thread(tpool_thread_4, started daemon 134850058794688)>, <Thread(tpool_thread_5, started daemon 134850050385600)>, <Thread(tpool_thread_6, started daemon 134850041976512)>, <Thread(tpool_thread_7, started daemon 134850033567424)>, <Thread(tpool_thread_8, started daemon 134850025158336)>, <Thread(tpool_thread_9, started daemon 134850016749248)>, <Thread(tpool_thread_10, started daemon 134850008340160)>, <Thread(tpool_thread_11, started daemon 134849999931072)>, <Thread(tpool_thread_12, started daemon 134849991521984)>, <Thread(tpool_thread_13, started daemon 134849983112896)>, <Thread(tpool_thread_14, started daemon 134849974703808)>, <Thread(tpool_thread_15, started daemon 134849966294720)>, <Thread(tpool_thread_16, started daemon 134849957885632)>, <Thread(tpool_thread_17, started daemon 134849949476544)>, <Thread(tpool_thread_18, started daemon 134849941067456)>, <Thread(tpool_thread_19, started daemon 134849932658368)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:24:15 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c1db3d8c-de9e-411c-b91a-f105ef06a1e2 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0.info" returned: 0 in 0.773s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:15 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-c1db3d8c-de9e-411c-b91a-f105ef06a1e2 tempest-ProjectReaderTests-1717421477 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0.info is being set with open permissions: ugo+rw
Jul 03 13:24:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c1db3d8c-de9e-411c-b91a-f105ef06a1e2 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:15 devstack sudo[106953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0.info
Jul 03 13:24:15 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:15 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e00e95a1-7a7f-48c8-81d1-0fed7d1f3028 tempest-VolumeDependencyTests-1287859259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe.414fb6c8-2071-4c78-9d27-71640a510bbe" returned: 0 in 0.703s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:15 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e00e95a1-7a7f-48c8-81d1-0fed7d1f3028 tempest-VolumeDependencyTests-1287859259 None] Lock "cinder-quobyte-414fb6c8-2071-4c78-9d27-71640a510bbe" released by "_delete_snapshot" :: held 3.282s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:15 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e00e95a1-7a7f-48c8-81d1-0fed7d1f3028 tempest-VolumeDependencyTests-1287859259 None] Lock "cinder-quobyte-e4b4076a-9544-4c92-8c1a-153afc29c8fe" released by "delete_snapshot" :: held 3.307s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:16 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-e00e95a1-7a7f-48c8-81d1-0fed7d1f3028 tempest-VolumeDependencyTests-1287859259 None] Created reservations ['18f0e9be-b5b2-4eea-89fa-0f6d2db8c251', '508c2bd9-149c-4a0a-8818-21451fcfc535', '7a577aae-df58-42f6-81b1-a79fb5c6b5e3', 'bb4f0510-71e4-42fd-8e80-0b3f226e2e1f'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:24:16 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-e00e95a1-7a7f-48c8-81d1-0fed7d1f3028 tempest-VolumeDependencyTests-1287859259 None] Delete snapshot completed successfully.
Jul 03 13:24:16 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e00e95a1-7a7f-48c8-81d1-0fed7d1f3028 tempest-VolumeDependencyTests-1287859259 None] Lock "cinder-414fb6c8-2071-4c78-9d27-71640a510bbe-delete_snapshot" released by "delete_snapshot" :: held 3.520s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:16 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c1db3d8c-de9e-411c-b91a-f105ef06a1e2 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0.info" returned: 0 in 0.655s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c1db3d8c-de9e-411c-b91a-f105ef06a1e2 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.454s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-dc6beb3b-15fa-403e-aae8-5aa7479c2afe tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.374s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:16 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-dc6beb3b-15fa-403e-aae8-5aa7479c2afe tempest-CreateVolumesFromSnapshotTest-173971802 None] Creating offline snapshot 0fcfcd07-d835-4aa1-807f-2bfab8e5046e of volume 915dc63a-5622-4c54-b7f9-cc2e4cbc1b78 {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:24:16 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-c1db3d8c-de9e-411c-b91a-f105ef06a1e2 tempest-ProjectReaderTests-1717421477 None] Create snapshot completed successfully
Jul 03 13:24:16 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ec4304-b25b-4baa-8f07-bd8e8c68b639]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dc6beb3b-15fa-403e-aae8-5aa7479c2afe tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:16 devstack sudo[106956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78
Jul 03 13:24:16 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:16 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-61d824ee-4d61-491a-a0e1-6a4f390d18e5 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "cinder-86b5b95f-7d2d-492c-a0b3-bbe31a63f3dd-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:16 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-61d824ee-4d61-491a-a0e1-6a4f390d18e5 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-86b5b95f-7d2d-492c-a0b3-bbe31a63f3dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:16 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-61d824ee-4d61-491a-a0e1-6a4f390d18e5 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "cinder-quobyte-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:16 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-61d824ee-4d61-491a-a0e1-6a4f390d18e5 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:16 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-61d824ee-4d61-491a-a0e1-6a4f390d18e5 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "cinder-quobyte-86b5b95f-7d2d-492c-a0b3-bbe31a63f3dd" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:16 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-61d824ee-4d61-491a-a0e1-6a4f390d18e5 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-86b5b95f-7d2d-492c-a0b3-bbe31a63f3dd" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:16 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-61d824ee-4d61-491a-a0e1-6a4f390d18e5 tempest-ProjectReaderTests-1717421477 None] Deleting offline snapshot 86b5b95f-7d2d-492c-a0b3-bbe31a63f3dd of volume bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:24:16 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-61d824ee-4d61-491a-a0e1-6a4f390d18e5 tempest-ProjectReaderTests-1717421477 None] snapshot_file for this snap is: volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0.86b5b95f-7d2d-492c-a0b3-bbe31a63f3dd {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:24:16 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c62e3b56-e19b-45c3-b5e6-454e4a5dcfa6 tempest-VolumeDependencyTests-1287859259 None] Acquiring lock "cinder-e4b4076a-9544-4c92-8c1a-153afc29c8fe-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:16 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08846e0-8afc-41b0-83c7-592c49eb4617]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-61d824ee-4d61-491a-a0e1-6a4f390d18e5 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0.86b5b95f-7d2d-492c-a0b3-bbe31a63f3dd {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:16 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c62e3b56-e19b-45c3-b5e6-454e4a5dcfa6 tempest-VolumeDependencyTests-1287859259 None] Lock "cinder-e4b4076a-9544-4c92-8c1a-153afc29c8fe-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:16 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c62e3b56-e19b-45c3-b5e6-454e4a5dcfa6 tempest-VolumeDependencyTests-1287859259 None] Acquiring lock "cinder-quobyte-e4b4076a-9544-4c92-8c1a-153afc29c8fe" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c62e3b56-e19b-45c3-b5e6-454e4a5dcfa6 tempest-VolumeDependencyTests-1287859259 None] Lock "cinder-quobyte-e4b4076a-9544-4c92-8c1a-153afc29c8fe" acquired by "delete_volume" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:17 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c55ae9-ea6b-415d-af4b-b8abadd6af6a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c62e3b56-e19b-45c3-b5e6-454e4a5dcfa6 tempest-VolumeDependencyTests-1287859259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:17 devstack sudo[106958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0.86b5b95f-7d2d-492c-a0b3-bbe31a63f3dd
Jul 03 13:24:17 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:17 devstack sudo[106959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe
Jul 03 13:24:17 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:17 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dc6beb3b-15fa-403e-aae8-5aa7479c2afe tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78" returned: 0 in 0.881s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dc6beb3b-15fa-403e-aae8-5aa7479c2afe tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78.0fcfcd07-d835-4aa1-807f-2bfab8e5046e 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:17 devstack sudo[106965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78.0fcfcd07-d835-4aa1-807f-2bfab8e5046e 1G
Jul 03 13:24:17 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:17 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-61d824ee-4d61-491a-a0e1-6a4f390d18e5 tempest-ProjectReaderTests-1717421477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0.86b5b95f-7d2d-492c-a0b3-bbe31a63f3dd" returned: 0 in 0.803s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:17 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-61d824ee-4d61-491a-a0e1-6a4f390d18e5 tempest-ProjectReaderTests-1717421477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:24:17 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a5a331-5688-487d-8718-8c95bb709c3e]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-61d824ee-4d61-491a-a0e1-6a4f390d18e5 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:17 devstack sudo[106973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0
Jul 03 13:24:17 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:17 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c62e3b56-e19b-45c3-b5e6-454e4a5dcfa6 tempest-VolumeDependencyTests-1287859259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe" returned: 0 in 0.829s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c62e3b56-e19b-45c3-b5e6-454e4a5dcfa6 tempest-VolumeDependencyTests-1287859259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:17 devstack sudo[106975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe
Jul 03 13:24:17 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:18 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dc6beb3b-15fa-403e-aae8-5aa7479c2afe tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78.0fcfcd07-d835-4aa1-807f-2bfab8e5046e 1G" returned: 0 in 0.901s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dc6beb3b-15fa-403e-aae8-5aa7479c2afe tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78.0fcfcd07-d835-4aa1-807f-2bfab8e5046e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:18 devstack sudo[106980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78.0fcfcd07-d835-4aa1-807f-2bfab8e5046e
Jul 03 13:24:18 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:18 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c62e3b56-e19b-45c3-b5e6-454e4a5dcfa6 tempest-VolumeDependencyTests-1287859259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e4b4076a-9544-4c92-8c1a-153afc29c8fe" returned: 0 in 0.705s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:18 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-61d824ee-4d61-491a-a0e1-6a4f390d18e5 tempest-ProjectReaderTests-1717421477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0" returned: 0 in 0.847s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-61d824ee-4d61-491a-a0e1-6a4f390d18e5 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0.86b5b95f-7d2d-492c-a0b3-bbe31a63f3dd {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:18 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c62e3b56-e19b-45c3-b5e6-454e4a5dcfa6 tempest-VolumeDependencyTests-1287859259 None] Lock "cinder-quobyte-e4b4076a-9544-4c92-8c1a-153afc29c8fe" released by "delete_volume" :: held 1.609s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:18 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:UPDATE=127,cinder:SELECT=100,cinder:INSERT=36,cinder:DELETE=12 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:24:18 devstack sudo[106986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0.86b5b95f-7d2d-492c-a0b3-bbe31a63f3dd
Jul 03 13:24:18 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:18 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-c62e3b56-e19b-45c3-b5e6-454e4a5dcfa6 tempest-VolumeDependencyTests-1287859259 None] Created reservations ['b99d5908-eb10-4a58-84cb-66f24a69886b', '14403d6c-5cb2-45a5-9686-b84cce014e7a', 'd174c09e-9c7f-4e9b-a7b6-fb149e4bbe38', '4f15290f-cc55-49ba-8719-931447937c17'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:24:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c62e3b56-e19b-45c3-b5e6-454e4a5dcfa6 tempest-VolumeDependencyTests-1287859259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c62e3b56-e19b-45c3-b5e6-454e4a5dcfa6 tempest-VolumeDependencyTests-1287859259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:18 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c62e3b56-e19b-45c3-b5e6-454e4a5dcfa6 tempest-VolumeDependencyTests-1287859259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:18 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-c62e3b56-e19b-45c3-b5e6-454e4a5dcfa6 tempest-VolumeDependencyTests-1287859259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-c62e3b56-e19b-45c3-b5e6-454e4a5dcfa6 tempest-VolumeDependencyTests-1287859259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c62e3b56-e19b-45c3-b5e6-454e4a5dcfa6 tempest-VolumeDependencyTests-1287859259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:18 devstack sudo[106988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:24:18 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:19 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dc6beb3b-15fa-403e-aae8-5aa7479c2afe tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78.0fcfcd07-d835-4aa1-807f-2bfab8e5046e" returned: 0 in 0.743s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:19 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-dc6beb3b-15fa-403e-aae8-5aa7479c2afe tempest-CreateVolumesFromSnapshotTest-173971802 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78.0fcfcd07-d835-4aa1-807f-2bfab8e5046e is being set with open permissions: ugo+rw
Jul 03 13:24:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dc6beb3b-15fa-403e-aae8-5aa7479c2afe tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78.0fcfcd07-d835-4aa1-807f-2bfab8e5046e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:19 devstack sudo[106993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78.0fcfcd07-d835-4aa1-807f-2bfab8e5046e
Jul 03 13:24:19 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:19 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e229721d-e8f3-4190-a918-08655d93d1e5 tempest-VolumeDependencyTests-1287859259 None] Acquiring lock "cinder-e56fb1ba-b154-490a-9219-f086a8eec7f4-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:19 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e229721d-e8f3-4190-a918-08655d93d1e5 tempest-VolumeDependencyTests-1287859259 None] Lock "cinder-e56fb1ba-b154-490a-9219-f086a8eec7f4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:19 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e229721d-e8f3-4190-a918-08655d93d1e5 tempest-VolumeDependencyTests-1287859259 None] Acquiring lock "cinder-quobyte-e56fb1ba-b154-490a-9219-f086a8eec7f4" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:19 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e229721d-e8f3-4190-a918-08655d93d1e5 tempest-VolumeDependencyTests-1287859259 None] Lock "cinder-quobyte-e56fb1ba-b154-490a-9219-f086a8eec7f4" acquired by "delete_volume" :: waited 0.025s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:19 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe8abca-8460-41dc-854a-f7e979ae03dd]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e229721d-e8f3-4190-a918-08655d93d1e5 tempest-VolumeDependencyTests-1287859259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e56fb1ba-b154-490a-9219-f086a8eec7f4 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:19 devstack sudo[106999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e56fb1ba-b154-490a-9219-f086a8eec7f4
Jul 03 13:24:19 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:19 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-61d824ee-4d61-491a-a0e1-6a4f390d18e5 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0.86b5b95f-7d2d-492c-a0b3-bbe31a63f3dd" returned: 0 in 0.889s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-61d824ee-4d61-491a-a0e1-6a4f390d18e5 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0.86b5b95f-7d2d-492c-a0b3-bbe31a63f3dd {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:19 devstack sudo[107002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0.86b5b95f-7d2d-492c-a0b3-bbe31a63f3dd
Jul 03 13:24:19 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:19 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-c62e3b56-e19b-45c3-b5e6-454e4a5dcfa6 tempest-VolumeDependencyTests-1287859259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.815s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:19 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-c62e3b56-e19b-45c3-b5e6-454e4a5dcfa6 tempest-VolumeDependencyTests-1287859259 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:24:19 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-c62e3b56-e19b-45c3-b5e6-454e4a5dcfa6 tempest-VolumeDependencyTests-1287859259 None] Deleted volume successfully.
Jul 03 13:24:19 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=108,cinder:UPDATE=132,cinder:INSERT=43,cinder:DELETE=14 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:24:19 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c62e3b56-e19b-45c3-b5e6-454e4a5dcfa6 tempest-VolumeDependencyTests-1287859259 None] Lock "cinder-e4b4076a-9544-4c92-8c1a-153afc29c8fe-delete_volume" released by "delete_volume" :: held 2.713s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:19 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dc6beb3b-15fa-403e-aae8-5aa7479c2afe tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78.0fcfcd07-d835-4aa1-807f-2bfab8e5046e" returned: 0 in 0.743s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dc6beb3b-15fa-403e-aae8-5aa7479c2afe tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:19 devstack sudo[107005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78.info
Jul 03 13:24:19 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:20 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-61d824ee-4d61-491a-a0e1-6a4f390d18e5 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0.86b5b95f-7d2d-492c-a0b3-bbe31a63f3dd" returned: 0 in 0.690s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:20 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e229721d-e8f3-4190-a918-08655d93d1e5 tempest-VolumeDependencyTests-1287859259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e56fb1ba-b154-490a-9219-f086a8eec7f4" returned: 0 in 0.884s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e229721d-e8f3-4190-a918-08655d93d1e5 tempest-VolumeDependencyTests-1287859259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e56fb1ba-b154-490a-9219-f086a8eec7f4 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-61d824ee-4d61-491a-a0e1-6a4f390d18e5 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-86b5b95f-7d2d-492c-a0b3-bbe31a63f3dd" released by "_delete_snapshot" :: held 3.358s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-61d824ee-4d61-491a-a0e1-6a4f390d18e5 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0" released by "delete_snapshot" :: held 3.396s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:20 devstack sudo[107011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e56fb1ba-b154-490a-9219-f086a8eec7f4
Jul 03 13:24:20 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:20 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-61d824ee-4d61-491a-a0e1-6a4f390d18e5 tempest-ProjectReaderTests-1717421477 None] Created reservations ['aa742d8f-7e5e-486a-b58b-c10827b2ee70', '4d0f0cb3-be6f-498c-85c3-31fa0f621463', 'f1099290-2205-4e66-ad9d-b9f473823b11', 'eb6fbde6-b196-4a83-a982-3130fd0cea37'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:24:20 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-61d824ee-4d61-491a-a0e1-6a4f390d18e5 tempest-ProjectReaderTests-1717421477 None] Delete snapshot completed successfully.
Jul 03 13:24:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-61d824ee-4d61-491a-a0e1-6a4f390d18e5 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-86b5b95f-7d2d-492c-a0b3-bbe31a63f3dd-delete_snapshot" released by "delete_snapshot" :: held 3.570s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:20 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dc6beb3b-15fa-403e-aae8-5aa7479c2afe tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78.info" returned: 0 in 0.755s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:20 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-dc6beb3b-15fa-403e-aae8-5aa7479c2afe tempest-CreateVolumesFromSnapshotTest-173971802 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78.info is being set with open permissions: ugo+rw
Jul 03 13:24:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dc6beb3b-15fa-403e-aae8-5aa7479c2afe tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:20 devstack sudo[107014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78.info
Jul 03 13:24:20 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:20 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e229721d-e8f3-4190-a918-08655d93d1e5 tempest-VolumeDependencyTests-1287859259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e56fb1ba-b154-490a-9219-f086a8eec7f4" returned: 0 in 0.633s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e229721d-e8f3-4190-a918-08655d93d1e5 tempest-VolumeDependencyTests-1287859259 None] Lock "cinder-quobyte-e56fb1ba-b154-490a-9219-f086a8eec7f4" released by "delete_volume" :: held 1.557s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:20 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-e229721d-e8f3-4190-a918-08655d93d1e5 tempest-VolumeDependencyTests-1287859259 None] Created reservations ['750f127f-9f82-4deb-89a5-270fb97dcd52', 'e9259812-d511-4a10-9b28-578a68dc8be5', 'eff5d2f7-65a1-40f7-957f-0f58049da7a2', '80b59755-3153-4310-948e-cd51a970fb0e'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:24:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e229721d-e8f3-4190-a918-08655d93d1e5 tempest-VolumeDependencyTests-1287859259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e229721d-e8f3-4190-a918-08655d93d1e5 tempest-VolumeDependencyTests-1287859259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:20 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e229721d-e8f3-4190-a918-08655d93d1e5 tempest-VolumeDependencyTests-1287859259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:20 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e229721d-e8f3-4190-a918-08655d93d1e5 tempest-VolumeDependencyTests-1287859259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e229721d-e8f3-4190-a918-08655d93d1e5 tempest-VolumeDependencyTests-1287859259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e229721d-e8f3-4190-a918-08655d93d1e5 tempest-VolumeDependencyTests-1287859259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:21 devstack sudo[107017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:24:21 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:21 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-05c94d74-b8e8-4b94-99f4-d5c35395dd32 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "cinder-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:21 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-05c94d74-b8e8-4b94-99f4-d5c35395dd32 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:21 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-05c94d74-b8e8-4b94-99f4-d5c35395dd32 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "cinder-quobyte-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:21 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-05c94d74-b8e8-4b94-99f4-d5c35395dd32 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0" acquired by "delete_volume" :: waited 0.019s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:21 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3127a7-f557-405c-a4d8-4642c444ae7f]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-05c94d74-b8e8-4b94-99f4-d5c35395dd32 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:21 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dc6beb3b-15fa-403e-aae8-5aa7479c2afe tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78.info" returned: 0 in 0.686s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:21 devstack sudo[107020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0
Jul 03 13:24:21 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-dc6beb3b-15fa-403e-aae8-5aa7479c2afe tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.822s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-656124b9-30de-442c-a53f-1e67d3271c3f tempest-CinderUnicodeTest-1438954782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 16.121s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:21 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-656124b9-30de-442c-a53f-1e67d3271c3f tempest-CinderUnicodeTest-1438954782 None] Creating offline snapshot 3ce2dfc0-6506-4530-92d7-4cbf41dd59ca of volume 27e7e369-bb93-45d0-9a80-305f72d65c22 {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:24:21 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-dc6beb3b-15fa-403e-aae8-5aa7479c2afe tempest-CreateVolumesFromSnapshotTest-173971802 None] Create snapshot completed successfully
Jul 03 13:24:21 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[28248c01-dc66-46e7-a54f-e7888ed44f3a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-656124b9-30de-442c-a53f-1e67d3271c3f tempest-CinderUnicodeTest-1438954782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:21 devstack sudo[107022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22
Jul 03 13:24:21 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:21 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e229721d-e8f3-4190-a918-08655d93d1e5 tempest-VolumeDependencyTests-1287859259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.733s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:21 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-e229721d-e8f3-4190-a918-08655d93d1e5 tempest-VolumeDependencyTests-1287859259 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:24:21 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-e229721d-e8f3-4190-a918-08655d93d1e5 tempest-VolumeDependencyTests-1287859259 None] Deleted volume successfully.
Jul 03 13:24:21 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-e229721d-e8f3-4190-a918-08655d93d1e5 tempest-VolumeDependencyTests-1287859259 None] Lock "cinder-e56fb1ba-b154-490a-9219-f086a8eec7f4-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:22 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-05c94d74-b8e8-4b94-99f4-d5c35395dd32 tempest-ProjectReaderTests-1717421477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0" returned: 0 in 0.871s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-05c94d74-b8e8-4b94-99f4-d5c35395dd32 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:22 devstack sudo[107028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0
Jul 03 13:24:22 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:22 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-656124b9-30de-442c-a53f-1e67d3271c3f tempest-CinderUnicodeTest-1438954782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22" returned: 0 in 1.077s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-656124b9-30de-442c-a53f-1e67d3271c3f tempest-CinderUnicodeTest-1438954782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22.3ce2dfc0-6506-4530-92d7-4cbf41dd59ca 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:22 devstack sudo[107033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22.3ce2dfc0-6506-4530-92d7-4cbf41dd59ca 1G
Jul 03 13:24:22 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:22 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:24:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Flow 'volume_create_manager' (b3590cc0-56f2-4557-b646-f276f45c6da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:24:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af6f01e4-a947-4087-8a66-2a3462743ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af6f01e4-a947-4087-8a66-2a3462743ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-551059534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9cfaca5-e2f7-4573-a2cf-7824642a67d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='808f40c3de04432abd497101058ba5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:24:23Z,use_quota=True,user_id='459a1deef2fe4893b063a55a00d1ccc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c9e8b4-9753-4568-b3d4-8ac25a16420b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c9e8b4-9753-4568-b3d4-8ac25a16420b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58557584-adc1-48b4-bb41-77fed3036cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58557584-adc1-48b4-bb41-77fed3036cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9cfaca5-e2f7-4573-a2cf-7824642a67d2', 'volume_name': 'volume-d9cfaca5-e2f7-4573-a2cf-7824642a67d2', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (863302bc-1367-4368-b663-c6f323710a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (863302bc-1367-4368-b663-c6f323710a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:22 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd62b31-6bb3-4863-81f6-76988331e79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:22 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Volume d9cfaca5-e2f7-4573-a2cf-7824642a67d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9cfaca5-e2f7-4573-a2cf-7824642a67d2', 'volume_size': 1}
Jul 03 13:24:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:23 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-05c94d74-b8e8-4b94-99f4-d5c35395dd32 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0" returned: 0 in 1.045s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-05c94d74-b8e8-4b94-99f4-d5c35395dd32 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0" released by "delete_volume" :: held 1.994s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:23 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-05c94d74-b8e8-4b94-99f4-d5c35395dd32 tempest-ProjectReaderTests-1717421477 None] Created reservations ['0a1d6126-0e61-4a99-8de4-805a28af3b98', '7bbc2792-c9be-4d5d-be82-9a4f6210fbdc', '0d3a0272-cc6e-4e38-8d96-eca9adbe9495', '7f57c791-8e38-4907-998e-fbae90450cd7'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:24:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-05c94d74-b8e8-4b94-99f4-d5c35395dd32 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-05c94d74-b8e8-4b94-99f4-d5c35395dd32 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-05c94d74-b8e8-4b94-99f4-d5c35395dd32 tempest-ProjectReaderTests-1717421477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-05c94d74-b8e8-4b94-99f4-d5c35395dd32 tempest-ProjectReaderTests-1717421477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-05c94d74-b8e8-4b94-99f4-d5c35395dd32 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-05c94d74-b8e8-4b94-99f4-d5c35395dd32 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:23 devstack sudo[107042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:24:23 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:23 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:24:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Flow 'volume_create_manager' (aafa7cb4-ed15-4143-b56d-371e5543b40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:24:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6013b4a-14fc-4b65-ab1a-3be51286e9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6013b4a-14fc-4b65-ab1a-3be51286e9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-572254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2194ec40-591b-49e7-addf-59e9716aefef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='808f40c3de04432abd497101058ba5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:24:23Z,use_quota=True,user_id='459a1deef2fe4893b063a55a00d1ccc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b0b108a-8d88-4ba9-a4a1-7a69c234bc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b0b108a-8d88-4ba9-a4a1-7a69c234bc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cdfe452-29a2-405a-a15f-0177c5d659ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cdfe452-29a2-405a-a15f-0177c5d659ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2194ec40-591b-49e7-addf-59e9716aefef', 'volume_name': 'volume-2194ec40-591b-49e7-addf-59e9716aefef', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75bf3aad-7977-49c9-b4b1-664a116aab3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75bf3aad-7977-49c9-b4b1-664a116aab3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a89881-f075-438b-bb51-de4ae27e9158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:23 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Volume 2194ec40-591b-49e7-addf-59e9716aefef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2194ec40-591b-49e7-addf-59e9716aefef', 'volume_size': 1}
Jul 03 13:24:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-656124b9-30de-442c-a53f-1e67d3271c3f tempest-CinderUnicodeTest-1438954782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22.3ce2dfc0-6506-4530-92d7-4cbf41dd59ca 1G" returned: 0 in 1.294s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:23 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-656124b9-30de-442c-a53f-1e67d3271c3f tempest-CinderUnicodeTest-1438954782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27e7e369-bb93-45d0-9a80-305f72d65c22 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22.3ce2dfc0-6506-4530-92d7-4cbf41dd59ca {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:23 devstack sudo[107050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27e7e369-bb93-45d0-9a80-305f72d65c22 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22.3ce2dfc0-6506-4530-92d7-4cbf41dd59ca
Jul 03 13:24:23 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Flow 'volume_create_manager' (35b16b69-d948-42e7-ae48-40cee32521b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f4b980a-b116-4979-9778-e9d6ff99d05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f4b980a-b116-4979-9778-e9d6ff99d05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-432759482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c9f238b-0549-4a12-afe4-ca5e838996eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='808f40c3de04432abd497101058ba5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:24:24Z,use_quota=True,user_id='459a1deef2fe4893b063a55a00d1ccc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d340b22-be46-41a8-a890-86a696553b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d340b22-be46-41a8-a890-86a696553b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d21c8a7-d98b-4b2d-937f-debce042fe6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d21c8a7-d98b-4b2d-937f-debce042fe6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c9f238b-0549-4a12-afe4-ca5e838996eb', 'volume_name': 'volume-7c9f238b-0549-4a12-afe4-ca5e838996eb', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97934e76-4b79-44a8-b9fa-c1aad76eeb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97934e76-4b79-44a8-b9fa-c1aad76eeb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f47809c-96ae-4cc1-9385-212f797fd95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:24 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Volume 7c9f238b-0549-4a12-afe4-ca5e838996eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c9f238b-0549-4a12-afe4-ca5e838996eb', 'volume_size': 1}
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:24 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-05c94d74-b8e8-4b94-99f4-d5c35395dd32 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.053s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-05c94d74-b8e8-4b94-99f4-d5c35395dd32 tempest-ProjectReaderTests-1717421477 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:24:24 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-05c94d74-b8e8-4b94-99f4-d5c35395dd32 tempest-ProjectReaderTests-1717421477 None] Deleted volume successfully.
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-05c94d74-b8e8-4b94-99f4-d5c35395dd32 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-bd639e2c-80d1-48b1-b0ba-f129fe3d7ac0-delete_volume" released by "delete_volume" :: held 3.416s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Flow 'volume_create_manager' (ea08f878-b9a5-4e7d-83a7-68c43055bf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f687bb0-a663-4242-a484-fbd1f4021ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f687bb0-a663-4242-a484-fbd1f4021ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-674970254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7571625-c6fe-4041-95f8-77cca04f0e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='808f40c3de04432abd497101058ba5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:24:25Z,use_quota=True,user_id='459a1deef2fe4893b063a55a00d1ccc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e1470ab-ed98-4195-90c1-93646711bd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e1470ab-ed98-4195-90c1-93646711bd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fbcc1c6-ec65-4746-829f-c796a5c01517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fbcc1c6-ec65-4746-829f-c796a5c01517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7571625-c6fe-4041-95f8-77cca04f0e22', 'volume_name': 'volume-c7571625-c6fe-4041-95f8-77cca04f0e22', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fd0b9f3-e991-44de-9f03-9882e1f80b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fd0b9f3-e991-44de-9f03-9882e1f80b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af62abb-59a6-466e-887e-d5fd73c4ac89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:24 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Volume c7571625-c6fe-4041-95f8-77cca04f0e22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7571625-c6fe-4041-95f8-77cca04f0e22', 'volume_size': 1}
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:24 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-656124b9-30de-442c-a53f-1e67d3271c3f tempest-CinderUnicodeTest-1438954782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27e7e369-bb93-45d0-9a80-305f72d65c22 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22.3ce2dfc0-6506-4530-92d7-4cbf41dd59ca" returned: 0 in 1.141s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:24 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-656124b9-30de-442c-a53f-1e67d3271c3f tempest-CinderUnicodeTest-1438954782 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22.3ce2dfc0-6506-4530-92d7-4cbf41dd59ca is being set with open permissions: ugo+rw
Jul 03 13:24:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-656124b9-30de-442c-a53f-1e67d3271c3f tempest-CinderUnicodeTest-1438954782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22.3ce2dfc0-6506-4530-92d7-4cbf41dd59ca {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:24 devstack sudo[107057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22.3ce2dfc0-6506-4530-92d7-4cbf41dd59ca
Jul 03 13:24:24 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:25 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:24:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Flow 'volume_create_manager' (8ac08bc0-a9a3-4a52-b33f-a2c3a8497ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:24:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3691322d-3f19-42e5-a677-1e26fd66bfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3691322d-3f19-42e5-a677-1e26fd66bfbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1534915184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d3142f3-3411-482c-84cc-e3ecabe1e641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9b9895e6094ba491a40e642c6a03b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:24:25Z,use_quota=True,user_id='8fca7bfb7d5b44a6a8b3f9e7153bf18a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dfca2a8-95d6-49eb-a4b6-3a1cf2f047a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dfca2a8-95d6-49eb-a4b6-3a1cf2f047a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7150bafa-f647-495d-b6eb-788c8f618ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7150bafa-f647-495d-b6eb-788c8f618ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d3142f3-3411-482c-84cc-e3ecabe1e641', 'volume_name': 'volume-7d3142f3-3411-482c-84cc-e3ecabe1e641', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccbdc907-4ffb-49fa-9e89-48166f9f56a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccbdc907-4ffb-49fa-9e89-48166f9f56a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a822dfe-d4b1-4f03-beda-ddbc7e7c22c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:25 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Volume 7d3142f3-3411-482c-84cc-e3ecabe1e641: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d3142f3-3411-482c-84cc-e3ecabe1e641', 'volume_size': 1}
Jul 03 13:24:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:25 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:24:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Flow 'volume_create_manager' (f76379e8-a133-4ec2-bb41-5f79f760f547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:24:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b554cad3-41fb-4dc0-ab4e-433444cee8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b554cad3-41fb-4dc0-ab4e-433444cee8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1631743813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7529463-57fb-49e9-97df-e79f4df7e8b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='808f40c3de04432abd497101058ba5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:24:25Z,use_quota=True,user_id='459a1deef2fe4893b063a55a00d1ccc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c8b740-b453-4a5c-9364-76f880668e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c8b740-b453-4a5c-9364-76f880668e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d47cf9c5-67e5-488a-a117-5719e0e83010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d47cf9c5-67e5-488a-a117-5719e0e83010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7529463-57fb-49e9-97df-e79f4df7e8b7', 'volume_name': 'volume-c7529463-57fb-49e9-97df-e79f4df7e8b7', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf84747-faf0-4597-8057-8a51e40e2a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf84747-faf0-4597-8057-8a51e40e2a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:25 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a6641a-1081-457f-a4e8-1dc2581a28ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:25 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Volume c7529463-57fb-49e9-97df-e79f4df7e8b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7529463-57fb-49e9-97df-e79f4df7e8b7', 'volume_size': 1}
Jul 03 13:24:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:25 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-656124b9-30de-442c-a53f-1e67d3271c3f tempest-CinderUnicodeTest-1438954782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22.3ce2dfc0-6506-4530-92d7-4cbf41dd59ca" returned: 0 in 0.772s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-656124b9-30de-442c-a53f-1e67d3271c3f tempest-CinderUnicodeTest-1438954782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:25 devstack sudo[107094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22.info
Jul 03 13:24:25 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:26 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-656124b9-30de-442c-a53f-1e67d3271c3f tempest-CinderUnicodeTest-1438954782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22.info" returned: 0 in 0.692s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:26 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-656124b9-30de-442c-a53f-1e67d3271c3f tempest-CinderUnicodeTest-1438954782 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22.info is being set with open permissions: ugo+rw
Jul 03 13:24:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-656124b9-30de-442c-a53f-1e67d3271c3f tempest-CinderUnicodeTest-1438954782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:26 devstack sudo[107099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22.info
Jul 03 13:24:26 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:26 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3cb1f967-046e-4f8b-b40d-b197601cb0db tempest-ProjectAdminTests-1004887616 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5812377929688, 'free_capacity_gb': 1775.5812377929688, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86837) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 03 13:24:27 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-656124b9-30de-442c-a53f-1e67d3271c3f tempest-CinderUnicodeTest-1438954782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22.info" returned: 0 in 0.686s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-656124b9-30de-442c-a53f-1e67d3271c3f tempest-CinderUnicodeTest-1438954782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.784s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.164s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:27 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-551059534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9cfaca5-e2f7-4573-a2cf-7824642a67d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='808f40c3de04432abd497101058ba5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:24:23Z,use_quota=True,user_id='459a1deef2fe4893b063a55a00d1ccc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:24:27 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Creating volume d9cfaca5-e2f7-4573-a2cf-7824642a67d2 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:24:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:27 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:27 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:27 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:24:27 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:24:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9cfaca5-e2f7-4573-a2cf-7824642a67d2 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:27 devstack sudo[107102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9cfaca5-e2f7-4573-a2cf-7824642a67d2 1073741824
Jul 03 13:24:27 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:27 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-656124b9-30de-442c-a53f-1e67d3271c3f tempest-CinderUnicodeTest-1438954782 None] Create snapshot completed successfully
Jul 03 13:24:28 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9cfaca5-e2f7-4573-a2cf-7824642a67d2 1073741824" returned: 0 in 0.988s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9cfaca5-e2f7-4573-a2cf-7824642a67d2 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:28 devstack sudo[107108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9cfaca5-e2f7-4573-a2cf-7824642a67d2
Jul 03 13:24:28 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:28 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-16cfad15-7515-49a7-8820-32d9b10d5fb6 tempest-CinderUnicodeTest-1438954782 None] Acquiring lock "cinder-3ce2dfc0-6506-4530-92d7-4cbf41dd59ca-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:28 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-16cfad15-7515-49a7-8820-32d9b10d5fb6 tempest-CinderUnicodeTest-1438954782 None] Lock "cinder-3ce2dfc0-6506-4530-92d7-4cbf41dd59ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:28 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-16cfad15-7515-49a7-8820-32d9b10d5fb6 tempest-CinderUnicodeTest-1438954782 None] Acquiring lock "cinder-quobyte-27e7e369-bb93-45d0-9a80-305f72d65c22" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:28 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-16cfad15-7515-49a7-8820-32d9b10d5fb6 tempest-CinderUnicodeTest-1438954782 None] Lock "cinder-quobyte-27e7e369-bb93-45d0-9a80-305f72d65c22" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:28 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-16cfad15-7515-49a7-8820-32d9b10d5fb6 tempest-CinderUnicodeTest-1438954782 None] Acquiring lock "cinder-quobyte-3ce2dfc0-6506-4530-92d7-4cbf41dd59ca" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:28 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-16cfad15-7515-49a7-8820-32d9b10d5fb6 tempest-CinderUnicodeTest-1438954782 None] Lock "cinder-quobyte-3ce2dfc0-6506-4530-92d7-4cbf41dd59ca" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:28 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-16cfad15-7515-49a7-8820-32d9b10d5fb6 tempest-CinderUnicodeTest-1438954782 None] Deleting offline snapshot 3ce2dfc0-6506-4530-92d7-4cbf41dd59ca of volume 27e7e369-bb93-45d0-9a80-305f72d65c22 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:24:28 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-16cfad15-7515-49a7-8820-32d9b10d5fb6 tempest-CinderUnicodeTest-1438954782 None] snapshot_file for this snap is: volume-27e7e369-bb93-45d0-9a80-305f72d65c22.3ce2dfc0-6506-4530-92d7-4cbf41dd59ca {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:24:28 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7a42a3-bf9e-41de-97be-94c93516297b]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-16cfad15-7515-49a7-8820-32d9b10d5fb6 tempest-CinderUnicodeTest-1438954782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22.3ce2dfc0-6506-4530-92d7-4cbf41dd59ca {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:28 devstack sudo[107110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22.3ce2dfc0-6506-4530-92d7-4cbf41dd59ca
Jul 03 13:24:28 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:28 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9cfaca5-e2f7-4573-a2cf-7824642a67d2" returned: 0 in 0.779s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:28 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:24:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.366s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:28 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-572254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2194ec40-591b-49e7-addf-59e9716aefef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='808f40c3de04432abd497101058ba5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:24:23Z,use_quota=True,user_id='459a1deef2fe4893b063a55a00d1ccc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:24:28 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Creating volume 2194ec40-591b-49e7-addf-59e9716aefef {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:24:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:28 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:28 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:28 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:24:28 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:24:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2194ec40-591b-49e7-addf-59e9716aefef 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:28 devstack sudo[107113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2194ec40-591b-49e7-addf-59e9716aefef 1073741824
Jul 03 13:24:28 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:28 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd62b31-6bb3-4863-81f6-76988331e79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9cfaca5-e2f7-4573-a2cf-7824642a67d2', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:28 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68a2d24-e39b-4a79-9354-a68e3e7d9895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:29 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Volume volume-d9cfaca5-e2f7-4573-a2cf-7824642a67d2 (d9cfaca5-e2f7-4573-a2cf-7824642a67d2): created successfully
Jul 03 13:24:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68a2d24-e39b-4a79-9354-a68e3e7d9895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:29 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Flow 'volume_create_manager' (b3590cc0-56f2-4557-b646-f276f45c6da9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:24:29 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-6174d884-15da-4035-83b7-9bbabb873f60 tempest-CreateVolumesFromSnapshotTest-173971802 None] Created volume successfully.
Jul 03 13:24:29 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-16cfad15-7515-49a7-8820-32d9b10d5fb6 tempest-CinderUnicodeTest-1438954782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22.3ce2dfc0-6506-4530-92d7-4cbf41dd59ca" returned: 0 in 0.850s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:29 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-16cfad15-7515-49a7-8820-32d9b10d5fb6 tempest-CinderUnicodeTest-1438954782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27e7e369-bb93-45d0-9a80-305f72d65c22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:24:29 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f0a7c6-6817-4aea-8878-7b38741c5ee2]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-16cfad15-7515-49a7-8820-32d9b10d5fb6 tempest-CinderUnicodeTest-1438954782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:29 devstack sudo[107119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22
Jul 03 13:24:29 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:29 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2194ec40-591b-49e7-addf-59e9716aefef 1073741824" returned: 0 in 1.022s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2194ec40-591b-49e7-addf-59e9716aefef {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:30 devstack sudo[107124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2194ec40-591b-49e7-addf-59e9716aefef
Jul 03 13:24:30 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:30 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-16cfad15-7515-49a7-8820-32d9b10d5fb6 tempest-CinderUnicodeTest-1438954782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22" returned: 0 in 0.853s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-16cfad15-7515-49a7-8820-32d9b10d5fb6 tempest-CinderUnicodeTest-1438954782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22.3ce2dfc0-6506-4530-92d7-4cbf41dd59ca {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:30 devstack sudo[107129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22.3ce2dfc0-6506-4530-92d7-4cbf41dd59ca
Jul 03 13:24:30 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:30 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2194ec40-591b-49e7-addf-59e9716aefef" returned: 0 in 0.688s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:24:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.298s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-432759482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c9f238b-0549-4a12-afe4-ca5e838996eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='808f40c3de04432abd497101058ba5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:24:24Z,use_quota=True,user_id='459a1deef2fe4893b063a55a00d1ccc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:24:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Creating volume 7c9f238b-0549-4a12-afe4-ca5e838996eb {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:24:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:24:30 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:24:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7c9f238b-0549-4a12-afe4-ca5e838996eb 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:30 devstack sudo[107132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7c9f238b-0549-4a12-afe4-ca5e838996eb 1073741824
Jul 03 13:24:30 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a89881-f075-438b-bb51-de4ae27e9158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2194ec40-591b-49e7-addf-59e9716aefef', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf2c2673-b603-485e-a80a-0be23583c720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:30 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Volume volume-2194ec40-591b-49e7-addf-59e9716aefef (2194ec40-591b-49e7-addf-59e9716aefef): created successfully
Jul 03 13:24:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf2c2673-b603-485e-a80a-0be23583c720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Flow 'volume_create_manager' (aafa7cb4-ed15-4143-b56d-371e5543b40c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:24:30 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-e7e45610-c0c6-4db3-b1b7-80df6c9d11ee tempest-CreateVolumesFromSnapshotTest-173971802 None] Created volume successfully.
Jul 03 13:24:31 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-16cfad15-7515-49a7-8820-32d9b10d5fb6 tempest-CinderUnicodeTest-1438954782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22.3ce2dfc0-6506-4530-92d7-4cbf41dd59ca" returned: 0 in 0.796s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-16cfad15-7515-49a7-8820-32d9b10d5fb6 tempest-CinderUnicodeTest-1438954782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22.3ce2dfc0-6506-4530-92d7-4cbf41dd59ca {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:31 devstack sudo[107137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22.3ce2dfc0-6506-4530-92d7-4cbf41dd59ca
Jul 03 13:24:31 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:31 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:24:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Flow 'volume_create_manager' (08c9c157-7103-444b-87e0-0b74da1094a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:24:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c466bd-1fb6-464b-a7f3-8671fc2b8ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c466bd-1fb6-464b-a7f3-8671fc2b8ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1961631067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65e3ad8-a926-4822-91b0-12a309990f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd09af1d03e4ff6af10af516c0c4564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:24:31Z,use_quota=True,user_id='4233fa171d584ae6927288bcb7b151c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d138eba0-04a2-41ea-8761-0bccadfda416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d138eba0-04a2-41ea-8761-0bccadfda416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50ee5da-a33a-471b-af93-f9ab7e1cc48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50ee5da-a33a-471b-af93-f9ab7e1cc48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b65e3ad8-a926-4822-91b0-12a309990f54', 'volume_name': 'volume-b65e3ad8-a926-4822-91b0-12a309990f54', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a732dd-b58c-44a8-a134-985f9bf26f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a732dd-b58c-44a8-a134-985f9bf26f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dfdc82a-379a-43c1-9fa6-83a83d4781d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:31 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Volume b65e3ad8-a926-4822-91b0-12a309990f54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b65e3ad8-a926-4822-91b0-12a309990f54', 'volume_size': 1}
Jul 03 13:24:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:31 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7c9f238b-0549-4a12-afe4-ca5e838996eb 1073741824" returned: 0 in 1.004s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7c9f238b-0549-4a12-afe4-ca5e838996eb {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:31 devstack sudo[107143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7c9f238b-0549-4a12-afe4-ca5e838996eb
Jul 03 13:24:31 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:31 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-16cfad15-7515-49a7-8820-32d9b10d5fb6 tempest-CinderUnicodeTest-1438954782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22.3ce2dfc0-6506-4530-92d7-4cbf41dd59ca" returned: 0 in 0.740s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:31 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-16cfad15-7515-49a7-8820-32d9b10d5fb6 tempest-CinderUnicodeTest-1438954782 None] Lock "cinder-quobyte-3ce2dfc0-6506-4530-92d7-4cbf41dd59ca" released by "_delete_snapshot" :: held 3.403s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:31 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-16cfad15-7515-49a7-8820-32d9b10d5fb6 tempest-CinderUnicodeTest-1438954782 None] Lock "cinder-quobyte-27e7e369-bb93-45d0-9a80-305f72d65c22" released by "delete_snapshot" :: held 3.447s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:31 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-16cfad15-7515-49a7-8820-32d9b10d5fb6 tempest-CinderUnicodeTest-1438954782 None] Created reservations ['a281cc70-ae5c-49d2-b933-99a666bb3161', '8303e742-6912-4703-b5f2-a4c4bf26e4cb', '0611971b-1275-44c2-ac9a-588db577545b', '60df9d59-3cd2-430a-b953-be3eaffafd2c'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:24:32 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-16cfad15-7515-49a7-8820-32d9b10d5fb6 tempest-CinderUnicodeTest-1438954782 None] Delete snapshot completed successfully.
Jul 03 13:24:32 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-16cfad15-7515-49a7-8820-32d9b10d5fb6 tempest-CinderUnicodeTest-1438954782 None] Lock "cinder-3ce2dfc0-6506-4530-92d7-4cbf41dd59ca-delete_snapshot" released by "delete_snapshot" :: held 3.616s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:32 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7c9f238b-0549-4a12-afe4-ca5e838996eb" returned: 0 in 0.722s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:24:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.608s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-674970254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7571625-c6fe-4041-95f8-77cca04f0e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='808f40c3de04432abd497101058ba5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:24:25Z,use_quota=True,user_id='459a1deef2fe4893b063a55a00d1ccc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:24:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Creating volume c7571625-c6fe-4041-95f8-77cca04f0e22 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:24:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:24:32 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:24:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7571625-c6fe-4041-95f8-77cca04f0e22 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f47809c-96ae-4cc1-9385-212f797fd95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c9f238b-0549-4a12-afe4-ca5e838996eb', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:32 devstack sudo[107146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7571625-c6fe-4041-95f8-77cca04f0e22 1073741824
Jul 03 13:24:32 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (372ac142-6d47-4708-adf9-b8cf2ad76cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:32 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Volume volume-7c9f238b-0549-4a12-afe4-ca5e838996eb (7c9f238b-0549-4a12-afe4-ca5e838996eb): created successfully
Jul 03 13:24:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (372ac142-6d47-4708-adf9-b8cf2ad76cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Flow 'volume_create_manager' (35b16b69-d948-42e7-ae48-40cee32521b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:24:32 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-93b2e1dd-ea66-4bea-95f0-95237212aaef tempest-CreateVolumesFromSnapshotTest-173971802 None] Created volume successfully.
Jul 03 13:24:32 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cd39f557-7115-4243-9488-9ab1d892a1ce tempest-CinderUnicodeTest-1438954782 None] Acquiring lock "cinder-27e7e369-bb93-45d0-9a80-305f72d65c22-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:32 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cd39f557-7115-4243-9488-9ab1d892a1ce tempest-CinderUnicodeTest-1438954782 None] Lock "cinder-27e7e369-bb93-45d0-9a80-305f72d65c22-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:32 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cd39f557-7115-4243-9488-9ab1d892a1ce tempest-CinderUnicodeTest-1438954782 None] Acquiring lock "cinder-quobyte-27e7e369-bb93-45d0-9a80-305f72d65c22" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:32 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cd39f557-7115-4243-9488-9ab1d892a1ce tempest-CinderUnicodeTest-1438954782 None] Lock "cinder-quobyte-27e7e369-bb93-45d0-9a80-305f72d65c22" acquired by "delete_volume" :: waited 0.015s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:32 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[335de630-a870-4892-8d57-751b407b98df]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cd39f557-7115-4243-9488-9ab1d892a1ce tempest-CinderUnicodeTest-1438954782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:32 devstack sudo[107148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22
Jul 03 13:24:32 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:33 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7571625-c6fe-4041-95f8-77cca04f0e22 1073741824" returned: 0 in 0.914s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7571625-c6fe-4041-95f8-77cca04f0e22 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:33 devstack sudo[107157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7571625-c6fe-4041-95f8-77cca04f0e22
Jul 03 13:24:33 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:33 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cd39f557-7115-4243-9488-9ab1d892a1ce tempest-CinderUnicodeTest-1438954782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22" returned: 0 in 0.783s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cd39f557-7115-4243-9488-9ab1d892a1ce tempest-CinderUnicodeTest-1438954782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:33 devstack sudo[107159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22
Jul 03 13:24:33 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:34 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7571625-c6fe-4041-95f8-77cca04f0e22" returned: 0 in 0.644s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.640s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1534915184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d3142f3-3411-482c-84cc-e3ecabe1e641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9b9895e6094ba491a40e642c6a03b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:24:25Z,use_quota=True,user_id='8fca7bfb7d5b44a6a8b3f9e7153bf18a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Creating volume 7d3142f3-3411-482c-84cc-e3ecabe1e641 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:24:34 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af62abb-59a6-466e-887e-d5fd73c4ac89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7571625-c6fe-4041-95f8-77cca04f0e22', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:34 devstack sudo[107162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641 1073741824
Jul 03 13:24:34 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d703280a-c6f0-4c5e-9527-9efe1ba7c84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:34 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Volume volume-c7571625-c6fe-4041-95f8-77cca04f0e22 (c7571625-c6fe-4041-95f8-77cca04f0e22): created successfully
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d703280a-c6f0-4c5e-9527-9efe1ba7c84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Flow 'volume_create_manager' (ea08f878-b9a5-4e7d-83a7-68c43055bf16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:24:34 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-20f634a0-9fb6-4057-965c-46914d66f540 tempest-CreateVolumesFromSnapshotTest-173971802 None] Created volume successfully.
Jul 03 13:24:34 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cd39f557-7115-4243-9488-9ab1d892a1ce tempest-CinderUnicodeTest-1438954782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-27e7e369-bb93-45d0-9a80-305f72d65c22" returned: 0 in 0.740s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cd39f557-7115-4243-9488-9ab1d892a1ce tempest-CinderUnicodeTest-1438954782 None] Lock "cinder-quobyte-27e7e369-bb93-45d0-9a80-305f72d65c22" released by "delete_volume" :: held 1.598s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-cd39f557-7115-4243-9488-9ab1d892a1ce tempest-CinderUnicodeTest-1438954782 None] Created reservations ['544a5bcc-bb31-411b-9821-b9fe1d9c7dd8', '2113c928-dc31-4cac-9419-62619619505a', '62df663a-e924-4cdd-8419-916690ff51f7', 'ebf62b2b-eeec-41a3-85b0-f365467d8841'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cd39f557-7115-4243-9488-9ab1d892a1ce tempest-CinderUnicodeTest-1438954782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cd39f557-7115-4243-9488-9ab1d892a1ce tempest-CinderUnicodeTest-1438954782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-cd39f557-7115-4243-9488-9ab1d892a1ce tempest-CinderUnicodeTest-1438954782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-cd39f557-7115-4243-9488-9ab1d892a1ce tempest-CinderUnicodeTest-1438954782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cd39f557-7115-4243-9488-9ab1d892a1ce tempest-CinderUnicodeTest-1438954782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cd39f557-7115-4243-9488-9ab1d892a1ce tempest-CinderUnicodeTest-1438954782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:34 devstack sudo[107165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:24:34 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-424be757-6373-46d7-91c2-cb2e0f7f6591 tempest-CinderUnicodeTest-1438954782 None] Acquiring lock "cinder-e1a5a40b-9984-4b10-ab7c-48f9ccce130d-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-424be757-6373-46d7-91c2-cb2e0f7f6591 tempest-CinderUnicodeTest-1438954782 None] Lock "cinder-e1a5a40b-9984-4b10-ab7c-48f9ccce130d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-424be757-6373-46d7-91c2-cb2e0f7f6591 tempest-CinderUnicodeTest-1438954782 None] Acquiring lock "cinder-quobyte-e1a5a40b-9984-4b10-ab7c-48f9ccce130d" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:34 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-424be757-6373-46d7-91c2-cb2e0f7f6591 tempest-CinderUnicodeTest-1438954782 None] Lock "cinder-quobyte-e1a5a40b-9984-4b10-ab7c-48f9ccce130d" acquired by "delete_volume" :: waited 0.015s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:35 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[02747a26-474c-4aad-8057-074e4c7b6caf]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-424be757-6373-46d7-91c2-cb2e0f7f6591 tempest-CinderUnicodeTest-1438954782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a5a40b-9984-4b10-ab7c-48f9ccce130d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:35 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641 1073741824" returned: 0 in 0.944s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:35 devstack sudo[107170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a5a40b-9984-4b10-ab7c-48f9ccce130d
Jul 03 13:24:35 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:35 devstack sudo[107172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641
Jul 03 13:24:35 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:35 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cd39f557-7115-4243-9488-9ab1d892a1ce tempest-CinderUnicodeTest-1438954782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.778s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:35 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-cd39f557-7115-4243-9488-9ab1d892a1ce tempest-CinderUnicodeTest-1438954782 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:24:35 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-cd39f557-7115-4243-9488-9ab1d892a1ce tempest-CinderUnicodeTest-1438954782 None] Deleted volume successfully.
Jul 03 13:24:35 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cd39f557-7115-4243-9488-9ab1d892a1ce tempest-CinderUnicodeTest-1438954782 None] Lock "cinder-27e7e369-bb93-45d0-9a80-305f72d65c22-delete_volume" released by "delete_volume" :: held 2.600s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:35 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641" returned: 0 in 0.656s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:24:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.219s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1631743813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7529463-57fb-49e9-97df-e79f4df7e8b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='808f40c3de04432abd497101058ba5ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:24:25Z,use_quota=True,user_id='459a1deef2fe4893b063a55a00d1ccc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:24:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Creating volume c7529463-57fb-49e9-97df-e79f4df7e8b7 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:24:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:35 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:24:35 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:24:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7529463-57fb-49e9-97df-e79f4df7e8b7 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a822dfe-d4b1-4f03-beda-ddbc7e7c22c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d3142f3-3411-482c-84cc-e3ecabe1e641', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:35 devstack sudo[107179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7529463-57fb-49e9-97df-e79f4df7e8b7 1073741824
Jul 03 13:24:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d7efbd-8183-4049-9bd6-f9ddd48c5c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:35 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-424be757-6373-46d7-91c2-cb2e0f7f6591 tempest-CinderUnicodeTest-1438954782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a5a40b-9984-4b10-ab7c-48f9ccce130d" returned: 0 in 0.838s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-424be757-6373-46d7-91c2-cb2e0f7f6591 tempest-CinderUnicodeTest-1438954782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a5a40b-9984-4b10-ab7c-48f9ccce130d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:35 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Volume volume-7d3142f3-3411-482c-84cc-e3ecabe1e641 (7d3142f3-3411-482c-84cc-e3ecabe1e641): created successfully
Jul 03 13:24:35 devstack sudo[107181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a5a40b-9984-4b10-ab7c-48f9ccce130d
Jul 03 13:24:35 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d7efbd-8183-4049-9bd6-f9ddd48c5c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Flow 'volume_create_manager' (8ac08bc0-a9a3-4a52-b33f-a2c3a8497ebf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:24:35 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-434d20f3-dd6f-46f3-a27d-de4f63920ec4 tempest-ProjectReaderTests-1717421477 None] Created volume successfully.
Jul 03 13:24:36 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-424be757-6373-46d7-91c2-cb2e0f7f6591 tempest-CinderUnicodeTest-1438954782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a5a40b-9984-4b10-ab7c-48f9ccce130d" returned: 0 in 0.735s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:36 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-424be757-6373-46d7-91c2-cb2e0f7f6591 tempest-CinderUnicodeTest-1438954782 None] Lock "cinder-quobyte-e1a5a40b-9984-4b10-ab7c-48f9ccce130d" released by "delete_volume" :: held 1.624s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:36 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7529463-57fb-49e9-97df-e79f4df7e8b7 1073741824" returned: 0 in 0.828s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:36 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-424be757-6373-46d7-91c2-cb2e0f7f6591 tempest-CinderUnicodeTest-1438954782 None] Created reservations ['74cf3c28-d15c-48d3-b112-af2819d02664', 'a3d5a7a1-4132-42ef-8c05-1831b0f3387b', 'b1141b23-e368-4af4-900b-514323ed5d94', '24695988-2068-41ad-8c56-a7ce2e41d535'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:24:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7529463-57fb-49e9-97df-e79f4df7e8b7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:36 devstack sudo[107187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7529463-57fb-49e9-97df-e79f4df7e8b7
Jul 03 13:24:36 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-424be757-6373-46d7-91c2-cb2e0f7f6591 tempest-CinderUnicodeTest-1438954782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-424be757-6373-46d7-91c2-cb2e0f7f6591 tempest-CinderUnicodeTest-1438954782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-424be757-6373-46d7-91c2-cb2e0f7f6591 tempest-CinderUnicodeTest-1438954782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-424be757-6373-46d7-91c2-cb2e0f7f6591 tempest-CinderUnicodeTest-1438954782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-424be757-6373-46d7-91c2-cb2e0f7f6591 tempest-CinderUnicodeTest-1438954782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-424be757-6373-46d7-91c2-cb2e0f7f6591 tempest-CinderUnicodeTest-1438954782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:36 devstack sudo[107189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:24:36 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3b6ccb7e-f779-4267-88b5-c90073e1ef6a tempest-ProjectReaderTests-1717421477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:37 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7529463-57fb-49e9-97df-e79f4df7e8b7" returned: 0 in 0.769s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:24:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:37 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.118s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1961631067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65e3ad8-a926-4822-91b0-12a309990f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd09af1d03e4ff6af10af516c0c4564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:24:31Z,use_quota=True,user_id='4233fa171d584ae6927288bcb7b151c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:24:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Creating volume b65e3ad8-a926-4822-91b0-12a309990f54 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:24:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:24:37 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:24:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b65e3ad8-a926-4822-91b0-12a309990f54 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-424be757-6373-46d7-91c2-cb2e0f7f6591 tempest-CinderUnicodeTest-1438954782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.752s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:37 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-424be757-6373-46d7-91c2-cb2e0f7f6591 tempest-CinderUnicodeTest-1438954782 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:24:37 devstack sudo[107193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b65e3ad8-a926-4822-91b0-12a309990f54 1073741824
Jul 03 13:24:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a6641a-1081-457f-a4e8-1dc2581a28ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7529463-57fb-49e9-97df-e79f4df7e8b7', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:37 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eea110f-80a0-472c-b454-aa00086cdeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:37 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-424be757-6373-46d7-91c2-cb2e0f7f6591 tempest-CinderUnicodeTest-1438954782 None] Deleted volume successfully.
Jul 03 13:24:37 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Volume volume-c7529463-57fb-49e9-97df-e79f4df7e8b7 (c7529463-57fb-49e9-97df-e79f4df7e8b7): created successfully
Jul 03 13:24:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eea110f-80a0-472c-b454-aa00086cdeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:37 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Flow 'volume_create_manager' (f76379e8-a133-4ec2-bb41-5f79f760f547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:24:37 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-aebef7a5-880b-4c57-be17-e90d11c7e165 tempest-CreateVolumesFromSnapshotTest-173971802 None] Created volume successfully.
Jul 03 13:24:37 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-424be757-6373-46d7-91c2-cb2e0f7f6591 tempest-CinderUnicodeTest-1438954782 None] Lock "cinder-e1a5a40b-9984-4b10-ab7c-48f9ccce130d-delete_volume" released by "delete_volume" :: held 2.670s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:38 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b65e3ad8-a926-4822-91b0-12a309990f54 1073741824" returned: 0 in 0.978s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b65e3ad8-a926-4822-91b0-12a309990f54 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:38 devstack sudo[107199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b65e3ad8-a926-4822-91b0-12a309990f54
Jul 03 13:24:38 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:38 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0ae67368-b5a1-419d-888a-fea8380df57a tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "cinder-c7529463-57fb-49e9-97df-e79f4df7e8b7-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:38 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0ae67368-b5a1-419d-888a-fea8380df57a tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-c7529463-57fb-49e9-97df-e79f4df7e8b7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:38 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0ae67368-b5a1-419d-888a-fea8380df57a tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "cinder-quobyte-c7529463-57fb-49e9-97df-e79f4df7e8b7" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:38 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0ae67368-b5a1-419d-888a-fea8380df57a tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-quobyte-c7529463-57fb-49e9-97df-e79f4df7e8b7" acquired by "delete_volume" :: waited 0.014s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:38 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe00cca-bd72-401e-bfd8-fbf958e3fbc4]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0ae67368-b5a1-419d-888a-fea8380df57a tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7529463-57fb-49e9-97df-e79f4df7e8b7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:38 devstack sudo[107201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7529463-57fb-49e9-97df-e79f4df7e8b7
Jul 03 13:24:38 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:39 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b65e3ad8-a926-4822-91b0-12a309990f54" returned: 0 in 0.755s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:24:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3b6ccb7e-f779-4267-88b5-c90073e1ef6a tempest-ProjectReaderTests-1717421477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:39 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-3b6ccb7e-f779-4267-88b5-c90073e1ef6a tempest-ProjectReaderTests-1717421477 None] Creating offline snapshot fdad5401-0a0d-4330-9e75-8125178ada02 of volume 7d3142f3-3411-482c-84cc-e3ecabe1e641 {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:24:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dfdc82a-379a-43c1-9fa6-83a83d4781d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b65e3ad8-a926-4822-91b0-12a309990f54', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878e15ab-3f19-4e51-aa50-62b34ba2627f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:39 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c2f682-842a-4cd6-b9a3-27b96eb94892]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3b6ccb7e-f779-4267-88b5-c90073e1ef6a tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:39 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Volume volume-b65e3ad8-a926-4822-91b0-12a309990f54 (b65e3ad8-a926-4822-91b0-12a309990f54): created successfully
Jul 03 13:24:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878e15ab-3f19-4e51-aa50-62b34ba2627f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:39 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Flow 'volume_create_manager' (08c9c157-7103-444b-87e0-0b74da1094a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:24:39 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-b0317c41-7e77-4eb5-9721-def5c6559c9f tempest-ProjectReaderTests-1300784187 None] Created volume successfully.
Jul 03 13:24:39 devstack sudo[107204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641
Jul 03 13:24:39 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:39 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0ae67368-b5a1-419d-888a-fea8380df57a tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7529463-57fb-49e9-97df-e79f4df7e8b7" returned: 0 in 0.832s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0ae67368-b5a1-419d-888a-fea8380df57a tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7529463-57fb-49e9-97df-e79f4df7e8b7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:39 devstack sudo[107209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7529463-57fb-49e9-97df-e79f4df7e8b7
Jul 03 13:24:39 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-43145ca4-f34f-4fd4-b6e3-af576557f29e tempest-ProjectReaderTests-1300784187 None] Acquiring lock "cinder-b65e3ad8-a926-4822-91b0-12a309990f54-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-43145ca4-f34f-4fd4-b6e3-af576557f29e tempest-ProjectReaderTests-1300784187 None] Lock "cinder-b65e3ad8-a926-4822-91b0-12a309990f54-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-43145ca4-f34f-4fd4-b6e3-af576557f29e tempest-ProjectReaderTests-1300784187 None] Acquiring lock "cinder-quobyte-b65e3ad8-a926-4822-91b0-12a309990f54" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-43145ca4-f34f-4fd4-b6e3-af576557f29e tempest-ProjectReaderTests-1300784187 None] Lock "cinder-quobyte-b65e3ad8-a926-4822-91b0-12a309990f54" acquired by "delete_volume" :: waited 0.034s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:40 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf440a5f-6ec9-4d86-b400-d2d5645b9a2d]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-43145ca4-f34f-4fd4-b6e3-af576557f29e tempest-ProjectReaderTests-1300784187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b65e3ad8-a926-4822-91b0-12a309990f54 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:40 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0ae67368-b5a1-419d-888a-fea8380df57a tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7529463-57fb-49e9-97df-e79f4df7e8b7" returned: 0 in 0.765s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0ae67368-b5a1-419d-888a-fea8380df57a tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-quobyte-c7529463-57fb-49e9-97df-e79f4df7e8b7" released by "delete_volume" :: held 1.653s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:40 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3b6ccb7e-f779-4267-88b5-c90073e1ef6a tempest-ProjectReaderTests-1717421477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641" returned: 0 in 1.061s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3b6ccb7e-f779-4267-88b5-c90073e1ef6a tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641.fdad5401-0a0d-4330-9e75-8125178ada02 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:40 devstack sudo[107215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b65e3ad8-a926-4822-91b0-12a309990f54
Jul 03 13:24:40 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:40 devstack sudo[107216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641.fdad5401-0a0d-4330-9e75-8125178ada02 1G
Jul 03 13:24:40 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:40 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-0ae67368-b5a1-419d-888a-fea8380df57a tempest-CreateVolumesFromSnapshotTest-173971802 None] Created reservations ['f3f880ff-cfb0-4f91-be26-497f605d3b8b', '23bf838c-88a7-4f1f-8166-465d60ac9ae8', 'c594cc7c-4dbb-4bee-897e-9c5418b65faa', 'f4e6742c-8efa-49e9-b03b-001a816a45e3'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:24:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0ae67368-b5a1-419d-888a-fea8380df57a tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0ae67368-b5a1-419d-888a-fea8380df57a tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:40 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0ae67368-b5a1-419d-888a-fea8380df57a tempest-CreateVolumesFromSnapshotTest-173971802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:40 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0ae67368-b5a1-419d-888a-fea8380df57a tempest-CreateVolumesFromSnapshotTest-173971802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0ae67368-b5a1-419d-888a-fea8380df57a tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0ae67368-b5a1-419d-888a-fea8380df57a tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:40 devstack sudo[107219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:24:40 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-bd398632-c0dc-4112-9f95-aa164ddea4e4 tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "cinder-c7571625-c6fe-4041-95f8-77cca04f0e22-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:41 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-bd398632-c0dc-4112-9f95-aa164ddea4e4 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-c7571625-c6fe-4041-95f8-77cca04f0e22-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:41 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-bd398632-c0dc-4112-9f95-aa164ddea4e4 tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "cinder-quobyte-c7571625-c6fe-4041-95f8-77cca04f0e22" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:41 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-bd398632-c0dc-4112-9f95-aa164ddea4e4 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-quobyte-c7571625-c6fe-4041-95f8-77cca04f0e22" acquired by "delete_volume" :: waited 0.030s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:41 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[160b7642-58cc-4d95-bc96-9ffedd80c0ef]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bd398632-c0dc-4112-9f95-aa164ddea4e4 tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7571625-c6fe-4041-95f8-77cca04f0e22 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:41 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-43145ca4-f34f-4fd4-b6e3-af576557f29e tempest-ProjectReaderTests-1300784187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b65e3ad8-a926-4822-91b0-12a309990f54" returned: 0 in 0.977s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-43145ca4-f34f-4fd4-b6e3-af576557f29e tempest-ProjectReaderTests-1300784187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b65e3ad8-a926-4822-91b0-12a309990f54 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:41 devstack sudo[107227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b65e3ad8-a926-4822-91b0-12a309990f54
Jul 03 13:24:41 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:41 devstack sudo[107224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7571625-c6fe-4041-95f8-77cca04f0e22
Jul 03 13:24:41 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:41 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0ae67368-b5a1-419d-888a-fea8380df57a tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.934s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:41 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-0ae67368-b5a1-419d-888a-fea8380df57a tempest-CreateVolumesFromSnapshotTest-173971802 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:24:41 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-0ae67368-b5a1-419d-888a-fea8380df57a tempest-CreateVolumesFromSnapshotTest-173971802 None] Deleted volume successfully.
Jul 03 13:24:41 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0ae67368-b5a1-419d-888a-fea8380df57a tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-c7529463-57fb-49e9-97df-e79f4df7e8b7-delete_volume" released by "delete_volume" :: held 2.897s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:41 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3b6ccb7e-f779-4267-88b5-c90073e1ef6a tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641.fdad5401-0a0d-4330-9e75-8125178ada02 1G" returned: 0 in 1.292s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3b6ccb7e-f779-4267-88b5-c90073e1ef6a tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d3142f3-3411-482c-84cc-e3ecabe1e641 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641.fdad5401-0a0d-4330-9e75-8125178ada02 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:41 devstack sudo[107233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d3142f3-3411-482c-84cc-e3ecabe1e641 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641.fdad5401-0a0d-4330-9e75-8125178ada02
Jul 03 13:24:41 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:42 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-43145ca4-f34f-4fd4-b6e3-af576557f29e tempest-ProjectReaderTests-1300784187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b65e3ad8-a926-4822-91b0-12a309990f54" returned: 0 in 0.895s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-43145ca4-f34f-4fd4-b6e3-af576557f29e tempest-ProjectReaderTests-1300784187 None] Lock "cinder-quobyte-b65e3ad8-a926-4822-91b0-12a309990f54" released by "delete_volume" :: held 1.954s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:42 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bd398632-c0dc-4112-9f95-aa164ddea4e4 tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7571625-c6fe-4041-95f8-77cca04f0e22" returned: 0 in 1.032s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bd398632-c0dc-4112-9f95-aa164ddea4e4 tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7571625-c6fe-4041-95f8-77cca04f0e22 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:42 devstack sudo[107239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7571625-c6fe-4041-95f8-77cca04f0e22
Jul 03 13:24:42 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:42 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-43145ca4-f34f-4fd4-b6e3-af576557f29e tempest-ProjectReaderTests-1300784187 None] Created reservations ['35904985-3283-478b-93a1-6e0d28d4de6e', '6454fdec-e465-40cb-9553-3e06d829f823', '90e3f53a-0717-4913-823b-69dbd8aabc6f', 'e7f551f4-8cfc-4068-aca1-21bd603aa149'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:24:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-43145ca4-f34f-4fd4-b6e3-af576557f29e tempest-ProjectReaderTests-1300784187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-43145ca4-f34f-4fd4-b6e3-af576557f29e tempest-ProjectReaderTests-1300784187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:42 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-43145ca4-f34f-4fd4-b6e3-af576557f29e tempest-ProjectReaderTests-1300784187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:42 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-43145ca4-f34f-4fd4-b6e3-af576557f29e tempest-ProjectReaderTests-1300784187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-43145ca4-f34f-4fd4-b6e3-af576557f29e tempest-ProjectReaderTests-1300784187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-43145ca4-f34f-4fd4-b6e3-af576557f29e tempest-ProjectReaderTests-1300784187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:42 devstack sudo[107244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:24:42 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:42 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3b6ccb7e-f779-4267-88b5-c90073e1ef6a tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d3142f3-3411-482c-84cc-e3ecabe1e641 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641.fdad5401-0a0d-4330-9e75-8125178ada02" returned: 0 in 0.737s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:42 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-3b6ccb7e-f779-4267-88b5-c90073e1ef6a tempest-ProjectReaderTests-1717421477 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641.fdad5401-0a0d-4330-9e75-8125178ada02 is being set with open permissions: ugo+rw
Jul 03 13:24:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3b6ccb7e-f779-4267-88b5-c90073e1ef6a tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641.fdad5401-0a0d-4330-9e75-8125178ada02 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:42 devstack sudo[107246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641.fdad5401-0a0d-4330-9e75-8125178ada02
Jul 03 13:24:42 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:42 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:24:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Flow 'volume_create_manager' (8f26cfe2-0090-420a-ba38-f5b428a146ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:24:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb12ca7-f68b-4b95-91ff-2f3b9c263d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb12ca7-f68b-4b95-91ff-2f3b9c263d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-482664701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aad15697-cdb4-438e-bb27-38947d711f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd09af1d03e4ff6af10af516c0c4564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:24:43Z,use_quota=True,user_id='4233fa171d584ae6927288bcb7b151c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca7e227-f181-4f3f-ab8e-a5469851aee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca7e227-f181-4f3f-ab8e-a5469851aee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bae5418-0c9f-420f-982c-2d6409b30c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bae5418-0c9f-420f-982c-2d6409b30c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aad15697-cdb4-438e-bb27-38947d711f18', 'volume_name': 'volume-aad15697-cdb4-438e-bb27-38947d711f18', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be03196f-12ed-4d2d-a72f-8d1cff98bcb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be03196f-12ed-4d2d-a72f-8d1cff98bcb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:43 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63f22094-833e-4823-9a11-d014790739a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:43 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Volume aad15697-cdb4-438e-bb27-38947d711f18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aad15697-cdb4-438e-bb27-38947d711f18', 'volume_size': 1}
Jul 03 13:24:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:43 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3b6ccb7e-f779-4267-88b5-c90073e1ef6a tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641.fdad5401-0a0d-4330-9e75-8125178ada02" returned: 0 in 0.860s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3b6ccb7e-f779-4267-88b5-c90073e1ef6a tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:43 devstack sudo[107252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641.info
Jul 03 13:24:43 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:43 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bd398632-c0dc-4112-9f95-aa164ddea4e4 tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-c7571625-c6fe-4041-95f8-77cca04f0e22" returned: 0 in 1.185s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:43 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-bd398632-c0dc-4112-9f95-aa164ddea4e4 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-quobyte-c7571625-c6fe-4041-95f8-77cca04f0e22" released by "delete_volume" :: held 2.273s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:43 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-43145ca4-f34f-4fd4-b6e3-af576557f29e tempest-ProjectReaderTests-1300784187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 1.099s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:43 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-43145ca4-f34f-4fd4-b6e3-af576557f29e tempest-ProjectReaderTests-1300784187 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:24:43 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-43145ca4-f34f-4fd4-b6e3-af576557f29e tempest-ProjectReaderTests-1300784187 None] Deleted volume successfully.
Jul 03 13:24:43 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-43145ca4-f34f-4fd4-b6e3-af576557f29e tempest-ProjectReaderTests-1300784187 None] Lock "cinder-b65e3ad8-a926-4822-91b0-12a309990f54-delete_volume" released by "delete_volume" :: held 3.345s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:43 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-bd398632-c0dc-4112-9f95-aa164ddea4e4 tempest-CreateVolumesFromSnapshotTest-173971802 None] Created reservations ['06106634-1031-4ab2-86da-24dc36ec9247', 'eeb01e20-62e3-4a27-b72e-a62237950b24', 'a884a8e6-2b8e-4fc1-b1a4-0f1fcc6c967e', '7830369a-0862-494b-b460-c9adfe236769'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:24:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bd398632-c0dc-4112-9f95-aa164ddea4e4 tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bd398632-c0dc-4112-9f95-aa164ddea4e4 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:43 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-bd398632-c0dc-4112-9f95-aa164ddea4e4 tempest-CreateVolumesFromSnapshotTest-173971802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:43 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-bd398632-c0dc-4112-9f95-aa164ddea4e4 tempest-CreateVolumesFromSnapshotTest-173971802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-bd398632-c0dc-4112-9f95-aa164ddea4e4 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bd398632-c0dc-4112-9f95-aa164ddea4e4 tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:43 devstack sudo[107254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:24:43 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:44 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3b6ccb7e-f779-4267-88b5-c90073e1ef6a tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641.info" returned: 0 in 0.736s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:44 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-3b6ccb7e-f779-4267-88b5-c90073e1ef6a tempest-ProjectReaderTests-1717421477 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641.info is being set with open permissions: ugo+rw
Jul 03 13:24:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3b6ccb7e-f779-4267-88b5-c90073e1ef6a tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:44 devstack sudo[107257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641.info
Jul 03 13:24:44 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:44 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-bd398632-c0dc-4112-9f95-aa164ddea4e4 tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.729s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:44 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-bd398632-c0dc-4112-9f95-aa164ddea4e4 tempest-CreateVolumesFromSnapshotTest-173971802 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:24:44 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6e4d1799-9129-4946-899b-fe748fb8d3a3 tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "cinder-7c9f238b-0549-4a12-afe4-ca5e838996eb-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:44 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-bd398632-c0dc-4112-9f95-aa164ddea4e4 tempest-CreateVolumesFromSnapshotTest-173971802 None] Deleted volume successfully.
Jul 03 13:24:44 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6e4d1799-9129-4946-899b-fe748fb8d3a3 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-7c9f238b-0549-4a12-afe4-ca5e838996eb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:44 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-bd398632-c0dc-4112-9f95-aa164ddea4e4 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-c7571625-c6fe-4041-95f8-77cca04f0e22-delete_volume" released by "delete_volume" :: held 3.394s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:44 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6e4d1799-9129-4946-899b-fe748fb8d3a3 tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "cinder-quobyte-7c9f238b-0549-4a12-afe4-ca5e838996eb" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:44 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6e4d1799-9129-4946-899b-fe748fb8d3a3 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-quobyte-7c9f238b-0549-4a12-afe4-ca5e838996eb" acquired by "delete_volume" :: waited 0.017s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:44 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[be461c28-7516-42a9-8185-b8bf64c09768]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6e4d1799-9129-4946-899b-fe748fb8d3a3 tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7c9f238b-0549-4a12-afe4-ca5e838996eb {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:44 devstack sudo[107260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7c9f238b-0549-4a12-afe4-ca5e838996eb
Jul 03 13:24:44 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:44 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3b6ccb7e-f779-4267-88b5-c90073e1ef6a tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7d3142f3-3411-482c-84cc-e3ecabe1e641.info" returned: 0 in 0.787s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3b6ccb7e-f779-4267-88b5-c90073e1ef6a tempest-ProjectReaderTests-1717421477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.570s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.750s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-482664701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aad15697-cdb4-438e-bb27-38947d711f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd09af1d03e4ff6af10af516c0c4564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:24:43Z,use_quota=True,user_id='4233fa171d584ae6927288bcb7b151c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:24:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Creating volume aad15697-cdb4-438e-bb27-38947d711f18 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:24:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:24:44 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:24:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-aad15697-cdb4-438e-bb27-38947d711f18 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:44 devstack sudo[107263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-aad15697-cdb4-438e-bb27-38947d711f18 1073741824
Jul 03 13:24:44 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:44 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-3b6ccb7e-f779-4267-88b5-c90073e1ef6a tempest-ProjectReaderTests-1717421477 None] Create snapshot completed successfully
Jul 03 13:24:45 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6e4d1799-9129-4946-899b-fe748fb8d3a3 tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7c9f238b-0549-4a12-afe4-ca5e838996eb" returned: 0 in 0.922s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6e4d1799-9129-4946-899b-fe748fb8d3a3 tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7c9f238b-0549-4a12-afe4-ca5e838996eb {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:45 devstack sudo[107268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7c9f238b-0549-4a12-afe4-ca5e838996eb
Jul 03 13:24:45 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f3537641-6a8f-4f4a-942d-085187df9cdd tempest-ProjectReaderTests-1717421477 None] Acquiring lock "cinder-fdad5401-0a0d-4330-9e75-8125178ada02-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f3537641-6a8f-4f4a-942d-085187df9cdd tempest-ProjectReaderTests-1717421477 None] Lock "cinder-fdad5401-0a0d-4330-9e75-8125178ada02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:45 devstack cinder-volume[86837]: INFO cinder.message.api [None req-f3537641-6a8f-4f4a-942d-085187df9cdd tempest-ProjectReaderTests-1717421477 None] Creating message record for request_id = req-f3537641-6a8f-4f4a-942d-085187df9cdd
Jul 03 13:24:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f3537641-6a8f-4f4a-942d-085187df9cdd tempest-ProjectReaderTests-1717421477 None] Lock "cinder-fdad5401-0a0d-4330-9e75-8125178ada02-delete_snapshot" released by "delete_snapshot" :: held 0.078s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:45 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server [None req-f3537641-6a8f-4f4a-942d-085187df9cdd tempest-ProjectReaderTests-1717421477 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'?
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server     skip_clean = func(self, context, snapshot, *args, **kwargs)
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server     return f(*a, **k)
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server     raise self.value
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server     self.driver.unmanage_snapshot(snapshot)
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'?
Jul 03 13:24:45 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server 
Jul 03 13:24:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-aad15697-cdb4-438e-bb27-38947d711f18 1073741824" returned: 0 in 1.015s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-aad15697-cdb4-438e-bb27-38947d711f18 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:45 devstack sudo[107274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-aad15697-cdb4-438e-bb27-38947d711f18
Jul 03 13:24:45 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:46 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6e4d1799-9129-4946-899b-fe748fb8d3a3 tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7c9f238b-0549-4a12-afe4-ca5e838996eb" returned: 0 in 0.873s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:46 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6e4d1799-9129-4946-899b-fe748fb8d3a3 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-quobyte-7c9f238b-0549-4a12-afe4-ca5e838996eb" released by "delete_volume" :: held 1.834s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:46 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-6e4d1799-9129-4946-899b-fe748fb8d3a3 tempest-CreateVolumesFromSnapshotTest-173971802 None] Created reservations ['aafd064e-7adf-4402-9861-8ee8813ffbba', '99e64c16-0f85-4ed6-bfcb-43476a1e40a0', '183b5520-3555-46dc-b19c-ec5678d2a3f1', '0681474e-878b-4d23-acaa-a73f1952357f'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:24:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6e4d1799-9129-4946-899b-fe748fb8d3a3 tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6e4d1799-9129-4946-899b-fe748fb8d3a3 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:46 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6e4d1799-9129-4946-899b-fe748fb8d3a3 tempest-CreateVolumesFromSnapshotTest-173971802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:46 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6e4d1799-9129-4946-899b-fe748fb8d3a3 tempest-CreateVolumesFromSnapshotTest-173971802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6e4d1799-9129-4946-899b-fe748fb8d3a3 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6e4d1799-9129-4946-899b-fe748fb8d3a3 tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:46 devstack sudo[107277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:24:46 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:46 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-988f314d-7700-4e35-a5e2-818a42abb97a tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "cinder-2194ec40-591b-49e7-addf-59e9716aefef-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:46 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-aad15697-cdb4-438e-bb27-38947d711f18" returned: 0 in 0.729s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:46 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:24:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:46 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-988f314d-7700-4e35-a5e2-818a42abb97a tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-2194ec40-591b-49e7-addf-59e9716aefef-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:46 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63f22094-833e-4823-9a11-d014790739a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aad15697-cdb4-438e-bb27-38947d711f18', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:46 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eacc81b-0459-4a22-b7d8-cd9108b3b4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:46 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-988f314d-7700-4e35-a5e2-818a42abb97a tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "cinder-quobyte-2194ec40-591b-49e7-addf-59e9716aefef" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:46 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Volume volume-aad15697-cdb4-438e-bb27-38947d711f18 (aad15697-cdb4-438e-bb27-38947d711f18): created successfully
Jul 03 13:24:46 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eacc81b-0459-4a22-b7d8-cd9108b3b4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:46 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Flow 'volume_create_manager' (8f26cfe2-0090-420a-ba38-f5b428a146ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:24:46 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-988f314d-7700-4e35-a5e2-818a42abb97a tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-quobyte-2194ec40-591b-49e7-addf-59e9716aefef" acquired by "delete_volume" :: waited 0.035s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:46 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-344463dd-6960-4714-bbee-aff996f14895 tempest-ProjectReaderTests-1300784187 None] Created volume successfully.
Jul 03 13:24:46 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a2e2d3-372b-451a-94a7-4389632ebf19]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-988f314d-7700-4e35-a5e2-818a42abb97a tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2194ec40-591b-49e7-addf-59e9716aefef {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:46 devstack sudo[107280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2194ec40-591b-49e7-addf-59e9716aefef
Jul 03 13:24:46 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:47 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6e4d1799-9129-4946-899b-fe748fb8d3a3 tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.744s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:47 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-6e4d1799-9129-4946-899b-fe748fb8d3a3 tempest-CreateVolumesFromSnapshotTest-173971802 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:24:47 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-6e4d1799-9129-4946-899b-fe748fb8d3a3 tempest-CreateVolumesFromSnapshotTest-173971802 None] Deleted volume successfully.
Jul 03 13:24:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-6e4d1799-9129-4946-899b-fe748fb8d3a3 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-7c9f238b-0549-4a12-afe4-ca5e838996eb-delete_volume" released by "delete_volume" :: held 2.797s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0b425469-b9d0-4b70-8372-eeb3e8a8d6e0 tempest-ProjectReaderTests-1300784187 None] Acquiring lock "cinder-aad15697-cdb4-438e-bb27-38947d711f18-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0b425469-b9d0-4b70-8372-eeb3e8a8d6e0 tempest-ProjectReaderTests-1300784187 None] Lock "cinder-aad15697-cdb4-438e-bb27-38947d711f18-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0b425469-b9d0-4b70-8372-eeb3e8a8d6e0 tempest-ProjectReaderTests-1300784187 None] Acquiring lock "cinder-quobyte-aad15697-cdb4-438e-bb27-38947d711f18" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0b425469-b9d0-4b70-8372-eeb3e8a8d6e0 tempest-ProjectReaderTests-1300784187 None] Lock "cinder-quobyte-aad15697-cdb4-438e-bb27-38947d711f18" acquired by "delete_volume" :: waited 0.022s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:47 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8b90b8-0e49-4475-af60-423d2e679e2a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0b425469-b9d0-4b70-8372-eeb3e8a8d6e0 tempest-ProjectReaderTests-1300784187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-aad15697-cdb4-438e-bb27-38947d711f18 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:47 devstack sudo[107283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-aad15697-cdb4-438e-bb27-38947d711f18
Jul 03 13:24:47 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:47 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-988f314d-7700-4e35-a5e2-818a42abb97a tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2194ec40-591b-49e7-addf-59e9716aefef" returned: 0 in 0.886s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-988f314d-7700-4e35-a5e2-818a42abb97a tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2194ec40-591b-49e7-addf-59e9716aefef {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:47 devstack sudo[107288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2194ec40-591b-49e7-addf-59e9716aefef
Jul 03 13:24:47 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:48 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0b425469-b9d0-4b70-8372-eeb3e8a8d6e0 tempest-ProjectReaderTests-1300784187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-aad15697-cdb4-438e-bb27-38947d711f18" returned: 0 in 0.826s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0b425469-b9d0-4b70-8372-eeb3e8a8d6e0 tempest-ProjectReaderTests-1300784187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-aad15697-cdb4-438e-bb27-38947d711f18 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:48 devstack sudo[107294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-aad15697-cdb4-438e-bb27-38947d711f18
Jul 03 13:24:48 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:48 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-988f314d-7700-4e35-a5e2-818a42abb97a tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2194ec40-591b-49e7-addf-59e9716aefef" returned: 0 in 0.752s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:48 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-988f314d-7700-4e35-a5e2-818a42abb97a tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-quobyte-2194ec40-591b-49e7-addf-59e9716aefef" released by "delete_volume" :: held 1.735s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:48 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-988f314d-7700-4e35-a5e2-818a42abb97a tempest-CreateVolumesFromSnapshotTest-173971802 None] Created reservations ['86207fc3-80af-4a85-97aa-0c0002ca052a', '6d7388dc-4549-470b-9adb-0a4e5989697a', '72a73daa-9767-42a8-b070-6ee8c3e21e62', '83a85593-e969-43af-80e8-a13293b80028'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:24:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-988f314d-7700-4e35-a5e2-818a42abb97a tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-988f314d-7700-4e35-a5e2-818a42abb97a tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:48 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-988f314d-7700-4e35-a5e2-818a42abb97a tempest-CreateVolumesFromSnapshotTest-173971802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:48 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-988f314d-7700-4e35-a5e2-818a42abb97a tempest-CreateVolumesFromSnapshotTest-173971802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-988f314d-7700-4e35-a5e2-818a42abb97a tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-988f314d-7700-4e35-a5e2-818a42abb97a tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:48 devstack sudo[107297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:24:48 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:48 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8fd63fdd-fc15-4957-8666-8033a6406a62 tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "cinder-d9cfaca5-e2f7-4573-a2cf-7824642a67d2-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:48 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8fd63fdd-fc15-4957-8666-8033a6406a62 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-d9cfaca5-e2f7-4573-a2cf-7824642a67d2-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8fd63fdd-fc15-4957-8666-8033a6406a62 tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "cinder-quobyte-d9cfaca5-e2f7-4573-a2cf-7824642a67d2" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8fd63fdd-fc15-4957-8666-8033a6406a62 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-quobyte-d9cfaca5-e2f7-4573-a2cf-7824642a67d2" acquired by "delete_volume" :: waited 0.029s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:49 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0b425469-b9d0-4b70-8372-eeb3e8a8d6e0 tempest-ProjectReaderTests-1300784187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-aad15697-cdb4-438e-bb27-38947d711f18" returned: 0 in 0.845s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:49 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc20668f-1f9d-45f2-a85d-97182c87c061]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8fd63fdd-fc15-4957-8666-8033a6406a62 tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9cfaca5-e2f7-4573-a2cf-7824642a67d2 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0b425469-b9d0-4b70-8372-eeb3e8a8d6e0 tempest-ProjectReaderTests-1300784187 None] Lock "cinder-quobyte-aad15697-cdb4-438e-bb27-38947d711f18" released by "delete_volume" :: held 1.762s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:49 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-0b425469-b9d0-4b70-8372-eeb3e8a8d6e0 tempest-ProjectReaderTests-1300784187 None] Created reservations ['9b0e234b-08e7-46b0-aa8b-88afd66c8020', '13774e25-aba4-4422-8387-9f78e98ec507', '9c1122fb-160c-43c2-90c4-e94e2fc8c2fd', 'c9b939d8-6a30-43c4-9419-dd6b581411b8'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:24:49 devstack sudo[107300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9cfaca5-e2f7-4573-a2cf-7824642a67d2
Jul 03 13:24:49 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0b425469-b9d0-4b70-8372-eeb3e8a8d6e0 tempest-ProjectReaderTests-1300784187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0b425469-b9d0-4b70-8372-eeb3e8a8d6e0 tempest-ProjectReaderTests-1300784187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0b425469-b9d0-4b70-8372-eeb3e8a8d6e0 tempest-ProjectReaderTests-1300784187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0b425469-b9d0-4b70-8372-eeb3e8a8d6e0 tempest-ProjectReaderTests-1300784187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0b425469-b9d0-4b70-8372-eeb3e8a8d6e0 tempest-ProjectReaderTests-1300784187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0b425469-b9d0-4b70-8372-eeb3e8a8d6e0 tempest-ProjectReaderTests-1300784187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:49 devstack sudo[107302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:24:49 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:49 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-988f314d-7700-4e35-a5e2-818a42abb97a tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.884s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:49 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-988f314d-7700-4e35-a5e2-818a42abb97a tempest-CreateVolumesFromSnapshotTest-173971802 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:24:49 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-988f314d-7700-4e35-a5e2-818a42abb97a tempest-CreateVolumesFromSnapshotTest-173971802 None] Deleted volume successfully.
Jul 03 13:24:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-988f314d-7700-4e35-a5e2-818a42abb97a tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-2194ec40-591b-49e7-addf-59e9716aefef-delete_volume" released by "delete_volume" :: held 2.924s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:50 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:50 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8fd63fdd-fc15-4957-8666-8033a6406a62 tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9cfaca5-e2f7-4573-a2cf-7824642a67d2" returned: 0 in 1.009s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8fd63fdd-fc15-4957-8666-8033a6406a62 tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9cfaca5-e2f7-4573-a2cf-7824642a67d2 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0b425469-b9d0-4b70-8372-eeb3e8a8d6e0 tempest-ProjectReaderTests-1300784187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.814s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:50 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-0b425469-b9d0-4b70-8372-eeb3e8a8d6e0 tempest-ProjectReaderTests-1300784187 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:24:50 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-0b425469-b9d0-4b70-8372-eeb3e8a8d6e0 tempest-ProjectReaderTests-1300784187 None] Deleted volume successfully.
Jul 03 13:24:50 devstack sudo[107309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9cfaca5-e2f7-4573-a2cf-7824642a67d2
Jul 03 13:24:50 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0b425469-b9d0-4b70-8372-eeb3e8a8d6e0 tempest-ProjectReaderTests-1300784187 None] Lock "cinder-aad15697-cdb4-438e-bb27-38947d711f18-delete_volume" released by "delete_volume" :: held 2.851s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:50 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8fd63fdd-fc15-4957-8666-8033a6406a62 tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-d9cfaca5-e2f7-4573-a2cf-7824642a67d2" returned: 0 in 0.700s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:50 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8fd63fdd-fc15-4957-8666-8033a6406a62 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-quobyte-d9cfaca5-e2f7-4573-a2cf-7824642a67d2" released by "delete_volume" :: held 1.788s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:50 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-8fd63fdd-fc15-4957-8666-8033a6406a62 tempest-CreateVolumesFromSnapshotTest-173971802 None] Created reservations ['4d8cc4d4-8ec0-43e9-9895-41edd475dd8c', '186ff365-80cb-4496-9d0b-c29fcaf5b259', 'b13bc0a8-4786-4193-8a7f-04cfd3f8c1c6', '47b6a8a3-7c65-40b0-b797-0fd7c6788d70'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:24:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8fd63fdd-fc15-4957-8666-8033a6406a62 tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8fd63fdd-fc15-4957-8666-8033a6406a62 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8fd63fdd-fc15-4957-8666-8033a6406a62 tempest-CreateVolumesFromSnapshotTest-173971802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-8fd63fdd-fc15-4957-8666-8033a6406a62 tempest-CreateVolumesFromSnapshotTest-173971802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-8fd63fdd-fc15-4957-8666-8033a6406a62 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8fd63fdd-fc15-4957-8666-8033a6406a62 tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:51 devstack sudo[107312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:24:51 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:51 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-395e0270-9cb7-49af-a7ba-b337ddb20a87 tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "cinder-0fcfcd07-d835-4aa1-807f-2bfab8e5046e-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:51 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-395e0270-9cb7-49af-a7ba-b337ddb20a87 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-0fcfcd07-d835-4aa1-807f-2bfab8e5046e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:51 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-395e0270-9cb7-49af-a7ba-b337ddb20a87 tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "cinder-quobyte-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:51 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-395e0270-9cb7-49af-a7ba-b337ddb20a87 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-quobyte-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:51 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-395e0270-9cb7-49af-a7ba-b337ddb20a87 tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "cinder-quobyte-0fcfcd07-d835-4aa1-807f-2bfab8e5046e" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:51 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-395e0270-9cb7-49af-a7ba-b337ddb20a87 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-quobyte-0fcfcd07-d835-4aa1-807f-2bfab8e5046e" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-395e0270-9cb7-49af-a7ba-b337ddb20a87 tempest-CreateVolumesFromSnapshotTest-173971802 None] Deleting offline snapshot 0fcfcd07-d835-4aa1-807f-2bfab8e5046e of volume 915dc63a-5622-4c54-b7f9-cc2e4cbc1b78 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:24:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-395e0270-9cb7-49af-a7ba-b337ddb20a87 tempest-CreateVolumesFromSnapshotTest-173971802 None] snapshot_file for this snap is: volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78.0fcfcd07-d835-4aa1-807f-2bfab8e5046e {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:24:51 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[6808087c-b5a1-405e-867b-c70ac18139d8]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-395e0270-9cb7-49af-a7ba-b337ddb20a87 tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78.0fcfcd07-d835-4aa1-807f-2bfab8e5046e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:51 devstack sudo[107314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78.0fcfcd07-d835-4aa1-807f-2bfab8e5046e
Jul 03 13:24:51 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:51 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-8fd63fdd-fc15-4957-8666-8033a6406a62 tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.801s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:51 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-8fd63fdd-fc15-4957-8666-8033a6406a62 tempest-CreateVolumesFromSnapshotTest-173971802 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:24:51 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-8fd63fdd-fc15-4957-8666-8033a6406a62 tempest-CreateVolumesFromSnapshotTest-173971802 None] Deleted volume successfully.
Jul 03 13:24:51 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-8fd63fdd-fc15-4957-8666-8033a6406a62 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-d9cfaca5-e2f7-4573-a2cf-7824642a67d2-delete_volume" released by "delete_volume" :: held 2.904s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:52 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-395e0270-9cb7-49af-a7ba-b337ddb20a87 tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78.0fcfcd07-d835-4aa1-807f-2bfab8e5046e" returned: 0 in 0.817s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-395e0270-9cb7-49af-a7ba-b337ddb20a87 tempest-CreateVolumesFromSnapshotTest-173971802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:24:52 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb8ac4a-7cad-42f6-8854-7c55e494eebd]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-395e0270-9cb7-49af-a7ba-b337ddb20a87 tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:52 devstack sudo[107320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78
Jul 03 13:24:52 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:52 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:24:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Flow 'volume_create_manager' (c57d367a-6d3d-484f-8138-aeabc55604ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:24:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b335a189-7a1e-4eab-8549-34e33b83ff1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b335a189-7a1e-4eab-8549-34e33b83ff1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-709489170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39abd9f4-aadb-46a0-9535-d88db4539bb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b42f1e3e9cc4110b7884b11f42477a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:24:53Z,use_quota=True,user_id='519a4061a63841fd94959f2853a9ac70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d6c1cc-062e-4ef8-b643-b6317430e256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d6c1cc-062e-4ef8-b643-b6317430e256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6401fb7-c6c8-43ca-9946-ac695bf2124f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6401fb7-c6c8-43ca-9946-ac695bf2124f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39abd9f4-aadb-46a0-9535-d88db4539bb3', 'volume_name': 'volume-39abd9f4-aadb-46a0-9535-d88db4539bb3', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (155b8c95-8527-4829-ad46-8af063204373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (155b8c95-8527-4829-ad46-8af063204373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:52 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e67da4-9a1f-4a43-aec5-8a08b311e269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:52 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Volume 39abd9f4-aadb-46a0-9535-d88db4539bb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39abd9f4-aadb-46a0-9535-d88db4539bb3', 'volume_size': 1}
Jul 03 13:24:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-709489170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39abd9f4-aadb-46a0-9535-d88db4539bb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b42f1e3e9cc4110b7884b11f42477a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:24:53Z,use_quota=True,user_id='519a4061a63841fd94959f2853a9ac70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:24:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Creating volume 39abd9f4-aadb-46a0-9535-d88db4539bb3 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:24:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:24:52 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:24:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-39abd9f4-aadb-46a0-9535-d88db4539bb3 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:52 devstack sudo[107322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-39abd9f4-aadb-46a0-9535-d88db4539bb3 1073741824
Jul 03 13:24:52 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:53 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-395e0270-9cb7-49af-a7ba-b337ddb20a87 tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78" returned: 0 in 0.758s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-395e0270-9cb7-49af-a7ba-b337ddb20a87 tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78.0fcfcd07-d835-4aa1-807f-2bfab8e5046e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:53 devstack sudo[107327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78.0fcfcd07-d835-4aa1-807f-2bfab8e5046e
Jul 03 13:24:53 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:53 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-39abd9f4-aadb-46a0-9535-d88db4539bb3 1073741824" returned: 0 in 0.837s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-39abd9f4-aadb-46a0-9535-d88db4539bb3 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:53 devstack sudo[107337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-39abd9f4-aadb-46a0-9535-d88db4539bb3
Jul 03 13:24:53 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:53 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-395e0270-9cb7-49af-a7ba-b337ddb20a87 tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78.0fcfcd07-d835-4aa1-807f-2bfab8e5046e" returned: 0 in 0.776s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-395e0270-9cb7-49af-a7ba-b337ddb20a87 tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78.0fcfcd07-d835-4aa1-807f-2bfab8e5046e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:53 devstack sudo[107339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78.0fcfcd07-d835-4aa1-807f-2bfab8e5046e
Jul 03 13:24:53 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:54 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-39abd9f4-aadb-46a0-9535-d88db4539bb3" returned: 0 in 0.647s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:54 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:24:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e67da4-9a1f-4a43-aec5-8a08b311e269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39abd9f4-aadb-46a0-9535-d88db4539bb3', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31fbb0dc-e2fb-4b49-bde8-7145bfb4d1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:54 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Volume volume-39abd9f4-aadb-46a0-9535-d88db4539bb3 (39abd9f4-aadb-46a0-9535-d88db4539bb3): created successfully
Jul 03 13:24:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31fbb0dc-e2fb-4b49-bde8-7145bfb4d1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:54 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Flow 'volume_create_manager' (c57d367a-6d3d-484f-8138-aeabc55604ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:24:54 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-619c0b1f-c082-4dcd-9525-6a7a027ff154 tempest-ProjectReaderTests-235125884 None] Created volume successfully.
Jul 03 13:24:54 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-395e0270-9cb7-49af-a7ba-b337ddb20a87 tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78.0fcfcd07-d835-4aa1-807f-2bfab8e5046e" returned: 0 in 0.645s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:54 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-395e0270-9cb7-49af-a7ba-b337ddb20a87 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-quobyte-0fcfcd07-d835-4aa1-807f-2bfab8e5046e" released by "_delete_snapshot" :: held 3.135s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:54 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-395e0270-9cb7-49af-a7ba-b337ddb20a87 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-quobyte-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78" released by "delete_snapshot" :: held 3.173s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:54 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-395e0270-9cb7-49af-a7ba-b337ddb20a87 tempest-CreateVolumesFromSnapshotTest-173971802 None] Created reservations ['4b5700b7-59c5-4eea-82b8-172d974f5bdd', '249bd284-c195-429e-bbdc-20ae36226c5b', 'f0b55d45-29fa-4c34-9a19-a8b83ad33b0a', '59dcb69a-28a0-444d-bad6-830a2512b0c9'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:24:54 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-395e0270-9cb7-49af-a7ba-b337ddb20a87 tempest-CreateVolumesFromSnapshotTest-173971802 None] Delete snapshot completed successfully.
Jul 03 13:24:54 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-395e0270-9cb7-49af-a7ba-b337ddb20a87 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-0fcfcd07-d835-4aa1-807f-2bfab8e5046e-delete_snapshot" released by "delete_snapshot" :: held 3.306s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:54 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b3ed3b4d-02a0-4e37-83fc-d92e145831e7 tempest-ProjectReaderTests-235125884 None] Acquiring lock "cinder-39abd9f4-aadb-46a0-9535-d88db4539bb3-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:54 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b3ed3b4d-02a0-4e37-83fc-d92e145831e7 tempest-ProjectReaderTests-235125884 None] Lock "cinder-39abd9f4-aadb-46a0-9535-d88db4539bb3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:54 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b3ed3b4d-02a0-4e37-83fc-d92e145831e7 tempest-ProjectReaderTests-235125884 None] Acquiring lock "cinder-quobyte-39abd9f4-aadb-46a0-9535-d88db4539bb3" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:54 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b3ed3b4d-02a0-4e37-83fc-d92e145831e7 tempest-ProjectReaderTests-235125884 None] Lock "cinder-quobyte-39abd9f4-aadb-46a0-9535-d88db4539bb3" acquired by "delete_volume" :: waited 0.015s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:55 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8a5185-8ad9-4c80-8e00-5da9f3f0c652]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b3ed3b4d-02a0-4e37-83fc-d92e145831e7 tempest-ProjectReaderTests-235125884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-39abd9f4-aadb-46a0-9535-d88db4539bb3 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:55 devstack sudo[107343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-39abd9f4-aadb-46a0-9535-d88db4539bb3
Jul 03 13:24:55 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d79b84b1-00cf-4638-95a9-e3db36ff38f0 tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "cinder-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d79b84b1-00cf-4638-95a9-e3db36ff38f0 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d79b84b1-00cf-4638-95a9-e3db36ff38f0 tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "cinder-quobyte-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:55 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d79b84b1-00cf-4638-95a9-e3db36ff38f0 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-quobyte-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78" acquired by "delete_volume" :: waited 0.015s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:55 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e789df8-92f6-4c04-a055-072486f06a3b]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d79b84b1-00cf-4638-95a9-e3db36ff38f0 tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:55 devstack sudo[107347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78
Jul 03 13:24:55 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:55 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b3ed3b4d-02a0-4e37-83fc-d92e145831e7 tempest-ProjectReaderTests-235125884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-39abd9f4-aadb-46a0-9535-d88db4539bb3" returned: 0 in 0.794s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b3ed3b4d-02a0-4e37-83fc-d92e145831e7 tempest-ProjectReaderTests-235125884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-39abd9f4-aadb-46a0-9535-d88db4539bb3 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:55 devstack sudo[107350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-39abd9f4-aadb-46a0-9535-d88db4539bb3
Jul 03 13:24:55 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:56 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d79b84b1-00cf-4638-95a9-e3db36ff38f0 tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78" returned: 0 in 0.788s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d79b84b1-00cf-4638-95a9-e3db36ff38f0 tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:56 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b3ed3b4d-02a0-4e37-83fc-d92e145831e7 tempest-ProjectReaderTests-235125884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-39abd9f4-aadb-46a0-9535-d88db4539bb3" returned: 0 in 0.637s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:56 devstack sudo[107356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78
Jul 03 13:24:56 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:56 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b3ed3b4d-02a0-4e37-83fc-d92e145831e7 tempest-ProjectReaderTests-235125884 None] Lock "cinder-quobyte-39abd9f4-aadb-46a0-9535-d88db4539bb3" released by "delete_volume" :: held 1.473s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:56 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-b3ed3b4d-02a0-4e37-83fc-d92e145831e7 tempest-ProjectReaderTests-235125884 None] Created reservations ['f220935d-4165-4008-901c-2546a2a05ecb', '8858bbe8-b2a6-4c5c-a783-93ca971f320e', 'fdd4195f-63ee-4cdf-9bd7-888cbbf0381d', 'adcc4955-9c92-45a6-ad31-4c9e514eed17'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:24:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b3ed3b4d-02a0-4e37-83fc-d92e145831e7 tempest-ProjectReaderTests-235125884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b3ed3b4d-02a0-4e37-83fc-d92e145831e7 tempest-ProjectReaderTests-235125884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b3ed3b4d-02a0-4e37-83fc-d92e145831e7 tempest-ProjectReaderTests-235125884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b3ed3b4d-02a0-4e37-83fc-d92e145831e7 tempest-ProjectReaderTests-235125884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b3ed3b4d-02a0-4e37-83fc-d92e145831e7 tempest-ProjectReaderTests-235125884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b3ed3b4d-02a0-4e37-83fc-d92e145831e7 tempest-ProjectReaderTests-235125884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:56 devstack sudo[107358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:24:56 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:57 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d79b84b1-00cf-4638-95a9-e3db36ff38f0 tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78" returned: 0 in 0.728s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d79b84b1-00cf-4638-95a9-e3db36ff38f0 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-quobyte-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78" released by "delete_volume" :: held 1.590s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-d79b84b1-00cf-4638-95a9-e3db36ff38f0 tempest-CreateVolumesFromSnapshotTest-173971802 None] Created reservations ['be76a14d-a2f5-4a88-9eed-893f07c2c2bc', 'b6dd41cf-03d8-4081-be0f-72f17a39dbe2', '19859687-a702-4f10-9fc0-07f9fc70cae5', '5cc5b06b-0a83-407b-a478-4166a5d7d4f6'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:24:57 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b3ed3b4d-02a0-4e37-83fc-d92e145831e7 tempest-ProjectReaderTests-235125884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.731s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-b3ed3b4d-02a0-4e37-83fc-d92e145831e7 tempest-ProjectReaderTests-235125884 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:24:57 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-b3ed3b4d-02a0-4e37-83fc-d92e145831e7 tempest-ProjectReaderTests-235125884 None] Deleted volume successfully.
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d79b84b1-00cf-4638-95a9-e3db36ff38f0 tempest-CreateVolumesFromSnapshotTest-173971802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d79b84b1-00cf-4638-95a9-e3db36ff38f0 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d79b84b1-00cf-4638-95a9-e3db36ff38f0 tempest-CreateVolumesFromSnapshotTest-173971802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d79b84b1-00cf-4638-95a9-e3db36ff38f0 tempest-CreateVolumesFromSnapshotTest-173971802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d79b84b1-00cf-4638-95a9-e3db36ff38f0 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d79b84b1-00cf-4638-95a9-e3db36ff38f0 tempest-CreateVolumesFromSnapshotTest-173971802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:57 devstack sudo[107362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b3ed3b4d-02a0-4e37-83fc-d92e145831e7 tempest-ProjectReaderTests-235125884 None] Lock "cinder-39abd9f4-aadb-46a0-9535-d88db4539bb3-delete_volume" released by "delete_volume" :: held 2.428s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:57 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Flow 'volume_create_manager' (04e6459a-2160-4d81-b27c-f3da4e6047c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (179e2f41-8a5d-4c87-9f65-e830edc135c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (179e2f41-8a5d-4c87-9f65-e830edc135c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-508405880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8bcfd56-b9ee-4e97-8707-0a8c7fd9e1f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b42f1e3e9cc4110b7884b11f42477a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:24:58Z,use_quota=True,user_id='519a4061a63841fd94959f2853a9ac70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8f36806-7ddd-4ec8-975d-4b21ff63fc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8f36806-7ddd-4ec8-975d-4b21ff63fc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc0b6903-a83c-4a12-bfd4-64f78d559ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc0b6903-a83c-4a12-bfd4-64f78d559ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8bcfd56-b9ee-4e97-8707-0a8c7fd9e1f8', 'volume_name': 'volume-a8bcfd56-b9ee-4e97-8707-0a8c7fd9e1f8', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b891eae7-a015-4649-acdd-db38f0e4d4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b891eae7-a015-4649-acdd-db38f0e4d4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5034fd79-712c-41ed-9726-7eef06a1ef87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:57 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Volume a8bcfd56-b9ee-4e97-8707-0a8c7fd9e1f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8bcfd56-b9ee-4e97-8707-0a8c7fd9e1f8', 'volume_size': 1}
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-508405880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8bcfd56-b9ee-4e97-8707-0a8c7fd9e1f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b42f1e3e9cc4110b7884b11f42477a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:24:58Z,use_quota=True,user_id='519a4061a63841fd94959f2853a9ac70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Creating volume a8bcfd56-b9ee-4e97-8707-0a8c7fd9e1f8 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:24:57 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:24:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a8bcfd56-b9ee-4e97-8707-0a8c7fd9e1f8 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:57 devstack sudo[107364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a8bcfd56-b9ee-4e97-8707-0a8c7fd9e1f8 1073741824
Jul 03 13:24:57 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:58 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d79b84b1-00cf-4638-95a9-e3db36ff38f0 tempest-CreateVolumesFromSnapshotTest-173971802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.696s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:58 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-d79b84b1-00cf-4638-95a9-e3db36ff38f0 tempest-CreateVolumesFromSnapshotTest-173971802 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:24:58 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-d79b84b1-00cf-4638-95a9-e3db36ff38f0 tempest-CreateVolumesFromSnapshotTest-173971802 None] Deleted volume successfully.
Jul 03 13:24:58 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d79b84b1-00cf-4638-95a9-e3db36ff38f0 tempest-CreateVolumesFromSnapshotTest-173971802 None] Lock "cinder-915dc63a-5622-4c54-b7f9-cc2e4cbc1b78-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:24:58 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a8bcfd56-b9ee-4e97-8707-0a8c7fd9e1f8 1073741824" returned: 0 in 1.032s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a8bcfd56-b9ee-4e97-8707-0a8c7fd9e1f8 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:58 devstack sudo[107372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a8bcfd56-b9ee-4e97-8707-0a8c7fd9e1f8
Jul 03 13:24:58 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:24:59 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root
Jul 03 13:24:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a8bcfd56-b9ee-4e97-8707-0a8c7fd9e1f8" returned: 0 in 0.682s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:24:59 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:24:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:24:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5034fd79-712c-41ed-9726-7eef06a1ef87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8bcfd56-b9ee-4e97-8707-0a8c7fd9e1f8', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd2fcbd3-1499-41e4-8a60-7671c9bb06d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:24:59 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Volume volume-a8bcfd56-b9ee-4e97-8707-0a8c7fd9e1f8 (a8bcfd56-b9ee-4e97-8707-0a8c7fd9e1f8): created successfully
Jul 03 13:24:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd2fcbd3-1499-41e4-8a60-7671c9bb06d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:24:59 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Flow 'volume_create_manager' (04e6459a-2160-4d81-b27c-f3da4e6047c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:24:59 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-28f179fe-4bb6-4aaa-864e-3fe94206604f tempest-ProjectReaderTests-235125884 None] Created volume successfully.
Jul 03 13:24:59 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1dd5e819-40ab-4646-a4b8-964089212f41 tempest-ProjectReaderTests-235125884 None] Acquiring lock "cinder-a8bcfd56-b9ee-4e97-8707-0a8c7fd9e1f8-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:59 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1dd5e819-40ab-4646-a4b8-964089212f41 tempest-ProjectReaderTests-235125884 None] Lock "cinder-a8bcfd56-b9ee-4e97-8707-0a8c7fd9e1f8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:59 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1dd5e819-40ab-4646-a4b8-964089212f41 tempest-ProjectReaderTests-235125884 None] Acquiring lock "cinder-quobyte-a8bcfd56-b9ee-4e97-8707-0a8c7fd9e1f8" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:24:59 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1dd5e819-40ab-4646-a4b8-964089212f41 tempest-ProjectReaderTests-235125884 None] Lock "cinder-quobyte-a8bcfd56-b9ee-4e97-8707-0a8c7fd9e1f8" acquired by "delete_volume" :: waited 0.017s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:24:59 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[07effbff-4ac6-461c-912c-4e36277105be]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:24:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1dd5e819-40ab-4646-a4b8-964089212f41 tempest-ProjectReaderTests-235125884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a8bcfd56-b9ee-4e97-8707-0a8c7fd9e1f8 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:24:59 devstack sudo[107375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a8bcfd56-b9ee-4e97-8707-0a8c7fd9e1f8
Jul 03 13:24:59 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:00 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1dd5e819-40ab-4646-a4b8-964089212f41 tempest-ProjectReaderTests-235125884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a8bcfd56-b9ee-4e97-8707-0a8c7fd9e1f8" returned: 0 in 0.845s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1dd5e819-40ab-4646-a4b8-964089212f41 tempest-ProjectReaderTests-235125884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a8bcfd56-b9ee-4e97-8707-0a8c7fd9e1f8 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:00 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:25:00 devstack sudo[107382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a8bcfd56-b9ee-4e97-8707-0a8c7fd9e1f8
Jul 03 13:25:00 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Flow 'volume_create_manager' (cf452f1f-bf67-4ec2-be0d-3982b4aaed3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:25:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (164c2856-15d8-4ea7-b269-fc3bf0172b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (164c2856-15d8-4ea7-b269-fc3bf0172b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1152509237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dfaa53a-42e6-4ddf-88eb-94edf30eb9b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e98ec8fcc3455f8d0a989f2859a01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:25:01Z,use_quota=True,user_id='2314eb2eadfe4732a102f3164da438ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45b6ffb-2f76-4b0a-9371-7e0cf9d576d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45b6ffb-2f76-4b0a-9371-7e0cf9d576d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd7b55e-5e74-4362-a944-d7466426249c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd7b55e-5e74-4362-a944-d7466426249c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dfaa53a-42e6-4ddf-88eb-94edf30eb9b1', 'volume_name': 'volume-9dfaa53a-42e6-4ddf-88eb-94edf30eb9b1', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce8b213-9d7b-4a6a-9b8b-a4ebecc427af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce8b213-9d7b-4a6a-9b8b-a4ebecc427af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:00 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (832cf783-de64-4416-8f2d-afd68129a3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:00 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Volume 9dfaa53a-42e6-4ddf-88eb-94edf30eb9b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dfaa53a-42e6-4ddf-88eb-94edf30eb9b1', 'volume_size': 1}
Jul 03 13:25:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1152509237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dfaa53a-42e6-4ddf-88eb-94edf30eb9b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e98ec8fcc3455f8d0a989f2859a01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:25:01Z,use_quota=True,user_id='2314eb2eadfe4732a102f3164da438ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:25:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Creating volume 9dfaa53a-42e6-4ddf-88eb-94edf30eb9b1 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:25:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:25:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:25:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:00 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:25:00 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:25:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9dfaa53a-42e6-4ddf-88eb-94edf30eb9b1 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:00 devstack sudo[107384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9dfaa53a-42e6-4ddf-88eb-94edf30eb9b1 1073741824
Jul 03 13:25:00 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:01 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1dd5e819-40ab-4646-a4b8-964089212f41 tempest-ProjectReaderTests-235125884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-a8bcfd56-b9ee-4e97-8707-0a8c7fd9e1f8" returned: 0 in 0.712s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:01 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1dd5e819-40ab-4646-a4b8-964089212f41 tempest-ProjectReaderTests-235125884 None] Lock "cinder-quobyte-a8bcfd56-b9ee-4e97-8707-0a8c7fd9e1f8" released by "delete_volume" :: held 1.608s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:25:01 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-1dd5e819-40ab-4646-a4b8-964089212f41 tempest-ProjectReaderTests-235125884 None] Created reservations ['9dc66307-cd99-4be6-b897-55ab4b1a0bc6', '7cad478b-afe5-4959-8976-28525bcc4bb7', '3540b97a-ee90-415c-b30a-2c6eb95c241f', '84e19732-5157-4ef6-9d35-fa1c24bd7130'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:25:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1dd5e819-40ab-4646-a4b8-964089212f41 tempest-ProjectReaderTests-235125884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1dd5e819-40ab-4646-a4b8-964089212f41 tempest-ProjectReaderTests-235125884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:01 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1dd5e819-40ab-4646-a4b8-964089212f41 tempest-ProjectReaderTests-235125884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:25:01 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1dd5e819-40ab-4646-a4b8-964089212f41 tempest-ProjectReaderTests-235125884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:25:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1dd5e819-40ab-4646-a4b8-964089212f41 tempest-ProjectReaderTests-235125884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1dd5e819-40ab-4646-a4b8-964089212f41 tempest-ProjectReaderTests-235125884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:01 devstack sudo[107394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:25:01 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:01 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9dfaa53a-42e6-4ddf-88eb-94edf30eb9b1 1073741824" returned: 0 in 0.954s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9dfaa53a-42e6-4ddf-88eb-94edf30eb9b1 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:01 devstack sudo[107396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9dfaa53a-42e6-4ddf-88eb-94edf30eb9b1
Jul 03 13:25:01 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:02 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1dd5e819-40ab-4646-a4b8-964089212f41 tempest-ProjectReaderTests-235125884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.852s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-1dd5e819-40ab-4646-a4b8-964089212f41 tempest-ProjectReaderTests-235125884 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Flow 'volume_create_manager' (9df7626b-4efd-4f94-80ae-7eeb8dc1ac4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22126802-2401-4935-9ff1-288f8ec23e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:02 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-1dd5e819-40ab-4646-a4b8-964089212f41 tempest-ProjectReaderTests-235125884 None] Deleted volume successfully.
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22126802-2401-4935-9ff1-288f8ec23e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-366185695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da11c6b0-c633-4150-9d0f-6a8f6ed8feff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b42f1e3e9cc4110b7884b11f42477a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:25:02Z,use_quota=True,user_id='519a4061a63841fd94959f2853a9ac70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fa7468f-47a7-4658-a80f-8fc5671ed763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fa7468f-47a7-4658-a80f-8fc5671ed763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a7d9c91-de2f-4d89-8966-f6c102a842a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a7d9c91-de2f-4d89-8966-f6c102a842a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da11c6b0-c633-4150-9d0f-6a8f6ed8feff', 'volume_name': 'volume-da11c6b0-c633-4150-9d0f-6a8f6ed8feff', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48d4e7d-4aee-40a7-82b4-39e78b0a86ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48d4e7d-4aee-40a7-82b4-39e78b0a86ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdd9f94-9ee4-44c4-89ff-f02042843757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:02 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Volume da11c6b0-c633-4150-9d0f-6a8f6ed8feff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da11c6b0-c633-4150-9d0f-6a8f6ed8feff', 'volume_size': 1}
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-1dd5e819-40ab-4646-a4b8-964089212f41 tempest-ProjectReaderTests-235125884 None] Lock "cinder-a8bcfd56-b9ee-4e97-8707-0a8c7fd9e1f8-delete_volume" released by "delete_volume" :: held 2.798s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:25:02 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9dfaa53a-42e6-4ddf-88eb-94edf30eb9b1" returned: 0 in 0.837s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.115s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-366185695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da11c6b0-c633-4150-9d0f-6a8f6ed8feff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b42f1e3e9cc4110b7884b11f42477a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:25:02Z,use_quota=True,user_id='519a4061a63841fd94959f2853a9ac70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Creating volume da11c6b0-c633-4150-9d0f-6a8f6ed8feff {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:25:02 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-da11c6b0-c633-4150-9d0f-6a8f6ed8feff 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:02 devstack sudo[107400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-da11c6b0-c633-4150-9d0f-6a8f6ed8feff 1073741824
Jul 03 13:25:02 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (832cf783-de64-4416-8f2d-afd68129a3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dfaa53a-42e6-4ddf-88eb-94edf30eb9b1', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (795460e8-1226-4e60-97fd-df7e12b8df4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:02 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Volume volume-9dfaa53a-42e6-4ddf-88eb-94edf30eb9b1 (9dfaa53a-42e6-4ddf-88eb-94edf30eb9b1): created successfully
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (795460e8-1226-4e60-97fd-df7e12b8df4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Flow 'volume_create_manager' (cf452f1f-bf67-4ec2-be0d-3982b4aaed3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:25:02 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-eccd500e-c3f9-4d38-9090-17f19170eb51 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Created volume successfully.
Jul 03 13:25:03 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-da11c6b0-c633-4150-9d0f-6a8f6ed8feff 1073741824" returned: 0 in 0.872s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-da11c6b0-c633-4150-9d0f-6a8f6ed8feff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:03 devstack sudo[107407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-da11c6b0-c633-4150-9d0f-6a8f6ed8feff
Jul 03 13:25:03 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:04 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-da11c6b0-c633-4150-9d0f-6a8f6ed8feff" returned: 0 in 0.671s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdd9f94-9ee4-44c4-89ff-f02042843757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da11c6b0-c633-4150-9d0f-6a8f6ed8feff', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5e226cb-ef77-4d63-a648-fe1e898911bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:04 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Volume volume-da11c6b0-c633-4150-9d0f-6a8f6ed8feff (da11c6b0-c633-4150-9d0f-6a8f6ed8feff): created successfully
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5e226cb-ef77-4d63-a648-fe1e898911bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Flow 'volume_create_manager' (9df7626b-4efd-4f94-80ae-7eeb8dc1ac4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:25:04 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-6c857776-32ef-4e0f-aa92-47dda1463fff tempest-ProjectReaderTests-235125884 None] Created volume successfully.
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Flow 'volume_create_manager' (aab3008c-4a6c-4dd6-b2c4-bf87c76989f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961e113d-eb4b-4720-865f-933f6137f243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961e113d-eb4b-4720-865f-933f6137f243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1613635817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a8900c-59ba-4b36-802a-6d15a59c51f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e98ec8fcc3455f8d0a989f2859a01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:25:04Z,use_quota=True,user_id='2314eb2eadfe4732a102f3164da438ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44279f6d-dd07-4b14-bc13-83624f37be0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44279f6d-dd07-4b14-bc13-83624f37be0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4082ec07-3459-4c69-b5f9-3e892de593f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4082ec07-3459-4c69-b5f9-3e892de593f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1a8900c-59ba-4b36-802a-6d15a59c51f3', 'volume_name': 'volume-e1a8900c-59ba-4b36-802a-6d15a59c51f3', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24c12fd4-464d-4dae-a125-edda0276d010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24c12fd4-464d-4dae-a125-edda0276d010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e19d3733-0ee4-400c-9b30-8e31cc0bea39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:04 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Volume e1a8900c-59ba-4b36-802a-6d15a59c51f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1a8900c-59ba-4b36-802a-6d15a59c51f3', 'volume_size': 1}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1613635817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a8900c-59ba-4b36-802a-6d15a59c51f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e98ec8fcc3455f8d0a989f2859a01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:25:04Z,use_quota=True,user_id='2314eb2eadfe4732a102f3164da438ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Creating volume e1a8900c-59ba-4b36-802a-6d15a59c51f3 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:25:04 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a8900c-59ba-4b36-802a-6d15a59c51f3 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:04 devstack sudo[107410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a8900c-59ba-4b36-802a-6d15a59c51f3 1073741824
Jul 03 13:25:04 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ed7236ae-f98a-453b-9fe4-ee449cfdaff8 tempest-ProjectReaderTests-235125884 None] Acquiring lock "cinder-da11c6b0-c633-4150-9d0f-6a8f6ed8feff-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ed7236ae-f98a-453b-9fe4-ee449cfdaff8 tempest-ProjectReaderTests-235125884 None] Lock "cinder-da11c6b0-c633-4150-9d0f-6a8f6ed8feff-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ed7236ae-f98a-453b-9fe4-ee449cfdaff8 tempest-ProjectReaderTests-235125884 None] Acquiring lock "cinder-quobyte-da11c6b0-c633-4150-9d0f-6a8f6ed8feff" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ed7236ae-f98a-453b-9fe4-ee449cfdaff8 tempest-ProjectReaderTests-235125884 None] Lock "cinder-quobyte-da11c6b0-c633-4150-9d0f-6a8f6ed8feff" acquired by "delete_volume" :: waited 0.036s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69b0052-d9ce-4db8-b330-bdbe2b6a545a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ed7236ae-f98a-453b-9fe4-ee449cfdaff8 tempest-ProjectReaderTests-235125884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-da11c6b0-c633-4150-9d0f-6a8f6ed8feff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Flow 'volume_create_manager' (8c77964b-e62c-4b06-954c-709aa7c9b11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:25:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5db27538-e5a2-4666-9c9d-5f48166f83e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:04 devstack sudo[107412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-da11c6b0-c633-4150-9d0f-6a8f6ed8feff
Jul 03 13:25:04 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5db27538-e5a2-4666-9c9d-5f48166f83e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-431978703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7719d227-2fc2-4f36-b256-4caf9a1521d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e98ec8fcc3455f8d0a989f2859a01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:25:05Z,use_quota=True,user_id='2314eb2eadfe4732a102f3164da438ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c45120e-1796-4c8d-8900-e79b1f26b0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c45120e-1796-4c8d-8900-e79b1f26b0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8e7a62-6340-4152-8935-a16b3ae579dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8e7a62-6340-4152-8935-a16b3ae579dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7719d227-2fc2-4f36-b256-4caf9a1521d1', 'volume_name': 'volume-7719d227-2fc2-4f36-b256-4caf9a1521d1', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b3cead-dadd-43db-b583-61b32ee62d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b3cead-dadd-43db-b583-61b32ee62d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4e540f0-8585-4341-b91d-c9978700c8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:05 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Volume 7719d227-2fc2-4f36-b256-4caf9a1521d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7719d227-2fc2-4f36-b256-4caf9a1521d1', 'volume_size': 1}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Flow 'volume_create_manager' (0527e3c3-b74f-4bd7-8148-3f16e63c98eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e0a57c-7878-47f7-82a5-b4b58dcd4efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e0a57c-7878-47f7-82a5-b4b58dcd4efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1069513802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8962e3d-679b-4089-82d5-7a228a084507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e98ec8fcc3455f8d0a989f2859a01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:25:05Z,use_quota=True,user_id='2314eb2eadfe4732a102f3164da438ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1899669d-cae3-49f9-bbf6-9afcd0488b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1899669d-cae3-49f9-bbf6-9afcd0488b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11eb160f-c483-4c03-a6bf-27f17ab17147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11eb160f-c483-4c03-a6bf-27f17ab17147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8962e3d-679b-4089-82d5-7a228a084507', 'volume_name': 'volume-b8962e3d-679b-4089-82d5-7a228a084507', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65c016b5-8807-48a4-ae91-c63e40f7ed9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65c016b5-8807-48a4-ae91-c63e40f7ed9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa26d835-55c7-45f0-acbe-2dca913b1e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:05 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Volume b8962e3d-679b-4089-82d5-7a228a084507: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8962e3d-679b-4089-82d5-7a228a084507', 'volume_size': 1}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:05 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a8900c-59ba-4b36-802a-6d15a59c51f3 1073741824" returned: 0 in 1.126s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Flow 'volume_create_manager' (a5839b67-ba6e-4b43-b255-e81e06b58ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e0f9c99-19be-411e-8a42-8874a0debed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e0f9c99-19be-411e-8a42-8874a0debed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1608205720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4397861c-c6cf-4483-a322-2ff811518cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e98ec8fcc3455f8d0a989f2859a01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:25:06Z,use_quota=True,user_id='2314eb2eadfe4732a102f3164da438ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe41c77-527a-4a3c-8ef0-e7f477cb928b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe41c77-527a-4a3c-8ef0-e7f477cb928b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6295f23-429e-46a7-aaaf-bb812e65591f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6295f23-429e-46a7-aaaf-bb812e65591f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4397861c-c6cf-4483-a322-2ff811518cd1', 'volume_name': 'volume-4397861c-c6cf-4483-a322-2ff811518cd1', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (660c6a37-d5eb-465d-b4e6-43f34d9c8ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (660c6a37-d5eb-465d-b4e6-43f34d9c8ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d88eca8-14de-4275-a7d2-1c958b177e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:05 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Volume 4397861c-c6cf-4483-a322-2ff811518cd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4397861c-c6cf-4483-a322-2ff811518cd1', 'volume_size': 1}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a8900c-59ba-4b36-802a-6d15a59c51f3 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:05 devstack sudo[107421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a8900c-59ba-4b36-802a-6d15a59c51f3
Jul 03 13:25:05 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:05 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ed7236ae-f98a-453b-9fe4-ee449cfdaff8 tempest-ProjectReaderTests-235125884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-da11c6b0-c633-4150-9d0f-6a8f6ed8feff" returned: 0 in 1.100s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ed7236ae-f98a-453b-9fe4-ee449cfdaff8 tempest-ProjectReaderTests-235125884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-da11c6b0-c633-4150-9d0f-6a8f6ed8feff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:05 devstack sudo[107423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-da11c6b0-c633-4150-9d0f-6a8f6ed8feff
Jul 03 13:25:05 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Flow 'volume_create_manager' (d2601a30-3c5a-43d7-ae10-873f002373a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee0796f-010f-49e3-a9fa-4bedd7a2762e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee0796f-010f-49e3-a9fa-4bedd7a2762e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-418770258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f5cf929-078c-483f-bc44-fee8540e97db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e98ec8fcc3455f8d0a989f2859a01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:25:06Z,use_quota=True,user_id='2314eb2eadfe4732a102f3164da438ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd55941b-7cfa-41ca-b620-cc5d7dca11fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd55941b-7cfa-41ca-b620-cc5d7dca11fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc0a1d1-ed64-4660-84b2-b7f5c567622a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc0a1d1-ed64-4660-84b2-b7f5c567622a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f5cf929-078c-483f-bc44-fee8540e97db', 'volume_name': 'volume-3f5cf929-078c-483f-bc44-fee8540e97db', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc45a6a-65ae-4d72-9c51-e63fd61bb952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc45a6a-65ae-4d72-9c51-e63fd61bb952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a70b0b28-e771-459a-982b-f82546e3c14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:06 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Volume 3f5cf929-078c-483f-bc44-fee8540e97db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f5cf929-078c-483f-bc44-fee8540e97db', 'volume_size': 1}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:06 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a8900c-59ba-4b36-802a-6d15a59c51f3" returned: 0 in 0.721s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] <== create_volume: return (1993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.996s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.462s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-431978703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7719d227-2fc2-4f36-b256-4caf9a1521d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e98ec8fcc3455f8d0a989f2859a01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:25:05Z,use_quota=True,user_id='2314eb2eadfe4732a102f3164da438ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Creating volume 7719d227-2fc2-4f36-b256-4caf9a1521d1 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:25:06 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7719d227-2fc2-4f36-b256-4caf9a1521d1 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e19d3733-0ee4-400c-9b30-8e31cc0bea39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1a8900c-59ba-4b36-802a-6d15a59c51f3', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad7bd28f-1768-4d2c-9332-61341b9bbb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:06 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:06 devstack sudo[107427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7719d227-2fc2-4f36-b256-4caf9a1521d1 1073741824
Jul 03 13:25:06 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ed7236ae-f98a-453b-9fe4-ee449cfdaff8 tempest-ProjectReaderTests-235125884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-da11c6b0-c633-4150-9d0f-6a8f6ed8feff" returned: 0 in 0.658s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:06 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Volume volume-e1a8900c-59ba-4b36-802a-6d15a59c51f3 (e1a8900c-59ba-4b36-802a-6d15a59c51f3): created successfully
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad7bd28f-1768-4d2c-9332-61341b9bbb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Flow 'volume_create_manager' (aab3008c-4a6c-4dd6-b2c4-bf87c76989f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ed7236ae-f98a-453b-9fe4-ee449cfdaff8 tempest-ProjectReaderTests-235125884 None] Lock "cinder-quobyte-da11c6b0-c633-4150-9d0f-6a8f6ed8feff" released by "delete_volume" :: held 1.831s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:25:06 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-6fcf2814-6bad-4071-9aae-8acd25303014 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Created volume successfully.
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-ed7236ae-f98a-453b-9fe4-ee449cfdaff8 tempest-ProjectReaderTests-235125884 None] Created reservations ['9809f390-b13a-4230-8885-5ae8db7fe48a', 'aab67cce-1546-499d-a262-5364202048f3', '97639c09-0ec2-4014-a98c-f5bf1aafd399', 'd773ceaa-ed30-4b0f-8ee3-019b552c004e'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ed7236ae-f98a-453b-9fe4-ee449cfdaff8 tempest-ProjectReaderTests-235125884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ed7236ae-f98a-453b-9fe4-ee449cfdaff8 tempest-ProjectReaderTests-235125884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ed7236ae-f98a-453b-9fe4-ee449cfdaff8 tempest-ProjectReaderTests-235125884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ed7236ae-f98a-453b-9fe4-ee449cfdaff8 tempest-ProjectReaderTests-235125884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ed7236ae-f98a-453b-9fe4-ee449cfdaff8 tempest-ProjectReaderTests-235125884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ed7236ae-f98a-453b-9fe4-ee449cfdaff8 tempest-ProjectReaderTests-235125884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:06 devstack sudo[107429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:25:06 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:07 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:07 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:25:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Flow 'volume_create_manager' (cef321f0-e57b-44f2-b9a6-19ff0e452def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:25:07 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e02d684-0382-4f9a-8c4e-1fa37c1c3b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ed7236ae-f98a-453b-9fe4-ee449cfdaff8 tempest-ProjectReaderTests-235125884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.768s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7719d227-2fc2-4f36-b256-4caf9a1521d1 1073741824" returned: 0 in 0.973s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:07 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-ed7236ae-f98a-453b-9fe4-ee449cfdaff8 tempest-ProjectReaderTests-235125884 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:25:07 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-ed7236ae-f98a-453b-9fe4-ee449cfdaff8 tempest-ProjectReaderTests-235125884 None] Deleted volume successfully.
Jul 03 13:25:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e02d684-0382-4f9a-8c4e-1fa37c1c3b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1262402912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e56916a-44c2-4479-afae-5c1f619a3d4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b42f1e3e9cc4110b7884b11f42477a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:25:07Z,use_quota=True,user_id='519a4061a63841fd94959f2853a9ac70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ad2e183-3635-426e-9e97-5a75b11f7dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ad2e183-3635-426e-9e97-5a75b11f7dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc68dc9a-cd43-44c2-80e2-e9ec7d74635e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc68dc9a-cd43-44c2-80e2-e9ec7d74635e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e56916a-44c2-4479-afae-5c1f619a3d4a', 'volume_name': 'volume-2e56916a-44c2-4479-afae-5c1f619a3d4a', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec432e0-9a3f-4221-b5b6-0f2079b23e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec432e0-9a3f-4221-b5b6-0f2079b23e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf214a1-4206-4d8f-8412-c3a31f01bb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:07 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Volume 2e56916a-44c2-4479-afae-5c1f619a3d4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e56916a-44c2-4479-afae-5c1f619a3d4a', 'volume_size': 1}
Jul 03 13:25:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ed7236ae-f98a-453b-9fe4-ee449cfdaff8 tempest-ProjectReaderTests-235125884 None] Lock "cinder-da11c6b0-c633-4150-9d0f-6a8f6ed8feff-delete_volume" released by "delete_volume" :: held 2.902s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:25:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7719d227-2fc2-4f36-b256-4caf9a1521d1 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:07 devstack sudo[107454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7719d227-2fc2-4f36-b256-4caf9a1521d1
Jul 03 13:25:07 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:08 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7719d227-2fc2-4f36-b256-4caf9a1521d1" returned: 0 in 0.676s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:25:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.954s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1069513802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8962e3d-679b-4089-82d5-7a228a084507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e98ec8fcc3455f8d0a989f2859a01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:25:05Z,use_quota=True,user_id='2314eb2eadfe4732a102f3164da438ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:25:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Creating volume b8962e3d-679b-4089-82d5-7a228a084507 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:25:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:25:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:25:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:25:08 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:25:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b8962e3d-679b-4089-82d5-7a228a084507 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4e540f0-8585-4341-b91d-c9978700c8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7719d227-2fc2-4f36-b256-4caf9a1521d1', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0904f459-c270-428d-9bf9-30c32f35b3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:08 devstack sudo[107771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b8962e3d-679b-4089-82d5-7a228a084507 1073741824
Jul 03 13:25:08 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:08 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Volume volume-7719d227-2fc2-4f36-b256-4caf9a1521d1 (7719d227-2fc2-4f36-b256-4caf9a1521d1): created successfully
Jul 03 13:25:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0904f459-c270-428d-9bf9-30c32f35b3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:08 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Flow 'volume_create_manager' (8c77964b-e62c-4b06-954c-709aa7c9b11e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:25:08 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-d610c4fc-61ab-4db4-b2cd-4737642912f9 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Created volume successfully.
Jul 03 13:25:09 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b8962e3d-679b-4089-82d5-7a228a084507 1073741824" returned: 0 in 0.848s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b8962e3d-679b-4089-82d5-7a228a084507 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:09 devstack sudo[107776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b8962e3d-679b-4089-82d5-7a228a084507
Jul 03 13:25:09 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:09 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b8962e3d-679b-4089-82d5-7a228a084507" returned: 0 in 0.657s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:25:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.087s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1608205720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4397861c-c6cf-4483-a322-2ff811518cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e98ec8fcc3455f8d0a989f2859a01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:25:06Z,use_quota=True,user_id='2314eb2eadfe4732a102f3164da438ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:25:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Creating volume 4397861c-c6cf-4483-a322-2ff811518cd1 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:25:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:25:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:25:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:25:09 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:25:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4397861c-c6cf-4483-a322-2ff811518cd1 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:09 devstack sudo[107779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4397861c-c6cf-4483-a322-2ff811518cd1 1073741824
Jul 03 13:25:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa26d835-55c7-45f0-acbe-2dca913b1e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8962e3d-679b-4089-82d5-7a228a084507', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:09 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763f3871-f7c4-4b0e-974d-85e3b933e0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:09 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Volume volume-b8962e3d-679b-4089-82d5-7a228a084507 (b8962e3d-679b-4089-82d5-7a228a084507): created successfully
Jul 03 13:25:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763f3871-f7c4-4b0e-974d-85e3b933e0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Flow 'volume_create_manager' (0527e3c3-b74f-4bd7-8148-3f16e63c98eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:25:09 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-1a4598cd-9aa1-439b-8217-c58aa215e3ea tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Created volume successfully.
Jul 03 13:25:10 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4397861c-c6cf-4483-a322-2ff811518cd1 1073741824" returned: 0 in 0.848s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4397861c-c6cf-4483-a322-2ff811518cd1 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:10 devstack sudo[107785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4397861c-c6cf-4483-a322-2ff811518cd1
Jul 03 13:25:10 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:11 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4397861c-c6cf-4483-a322-2ff811518cd1" returned: 0 in 0.658s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:25:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.232s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-418770258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f5cf929-078c-483f-bc44-fee8540e97db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e98ec8fcc3455f8d0a989f2859a01f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:25:06Z,use_quota=True,user_id='2314eb2eadfe4732a102f3164da438ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:25:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Creating volume 3f5cf929-078c-483f-bc44-fee8540e97db {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:25:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:25:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:25:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:25:11 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:25:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3f5cf929-078c-483f-bc44-fee8540e97db 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d88eca8-14de-4275-a7d2-1c958b177e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4397861c-c6cf-4483-a322-2ff811518cd1', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:11 devstack sudo[107788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3f5cf929-078c-483f-bc44-fee8540e97db 1073741824
Jul 03 13:25:11 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62c6596b-1af5-49a1-8bfb-6580ea2c56ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:11 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Volume volume-4397861c-c6cf-4483-a322-2ff811518cd1 (4397861c-c6cf-4483-a322-2ff811518cd1): created successfully
Jul 03 13:25:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62c6596b-1af5-49a1-8bfb-6580ea2c56ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Flow 'volume_create_manager' (a5839b67-ba6e-4b43-b255-e81e06b58ae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:25:11 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-13e5e56a-d612-45e1-a12f-a390500c0584 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Created volume successfully.
Jul 03 13:25:12 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3f5cf929-078c-483f-bc44-fee8540e97db 1073741824" returned: 0 in 0.833s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3f5cf929-078c-483f-bc44-fee8540e97db {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:12 devstack sudo[107794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3f5cf929-078c-483f-bc44-fee8540e97db
Jul 03 13:25:12 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:12 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3f5cf929-078c-483f-bc44-fee8540e97db" returned: 0 in 0.628s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:12 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:25:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.358s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:12 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1262402912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e56916a-44c2-4479-afae-5c1f619a3d4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b42f1e3e9cc4110b7884b11f42477a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:25:07Z,use_quota=True,user_id='519a4061a63841fd94959f2853a9ac70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:25:12 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Creating volume 2e56916a-44c2-4479-afae-5c1f619a3d4a {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:25:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:12 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:25:12 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:25:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:12 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:25:12 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:25:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2e56916a-44c2-4479-afae-5c1f619a3d4a 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:12 devstack sudo[107797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2e56916a-44c2-4479-afae-5c1f619a3d4a 1073741824
Jul 03 13:25:12 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:12 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a70b0b28-e771-459a-982b-f82546e3c14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f5cf929-078c-483f-bc44-fee8540e97db', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:12 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48223323-dac7-4fe9-954d-1bd677ece3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:12 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Volume volume-3f5cf929-078c-483f-bc44-fee8540e97db (3f5cf929-078c-483f-bc44-fee8540e97db): created successfully
Jul 03 13:25:12 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48223323-dac7-4fe9-954d-1bd677ece3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:12 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Flow 'volume_create_manager' (d2601a30-3c5a-43d7-ae10-873f002373a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:25:13 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-aa9706be-7262-458a-b8d2-085e35eb0766 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Created volume successfully.
Jul 03 13:25:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0807ce78-4ff1-4036-a940-a1e91dc2b85f tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "cinder-3f5cf929-078c-483f-bc44-fee8540e97db-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:25:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0807ce78-4ff1-4036-a940-a1e91dc2b85f tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "cinder-3f5cf929-078c-483f-bc44-fee8540e97db-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:25:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0807ce78-4ff1-4036-a940-a1e91dc2b85f tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "cinder-quobyte-3f5cf929-078c-483f-bc44-fee8540e97db" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:25:13 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0807ce78-4ff1-4036-a940-a1e91dc2b85f tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "cinder-quobyte-3f5cf929-078c-483f-bc44-fee8540e97db" acquired by "delete_volume" :: waited 0.018s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:25:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2e56916a-44c2-4479-afae-5c1f619a3d4a 1073741824" returned: 0 in 0.857s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:13 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2627db-f147-45df-83a6-52cc35276a68]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:25:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0807ce78-4ff1-4036-a940-a1e91dc2b85f tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3f5cf929-078c-483f-bc44-fee8540e97db {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2e56916a-44c2-4479-afae-5c1f619a3d4a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:13 devstack sudo[107891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2e56916a-44c2-4479-afae-5c1f619a3d4a
Jul 03 13:25:13 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:13 devstack sudo[107890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3f5cf929-078c-483f-bc44-fee8540e97db
Jul 03 13:25:13 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:14 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2e56916a-44c2-4479-afae-5c1f619a3d4a" returned: 0 in 0.682s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:25:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:14 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf214a1-4206-4d8f-8412-c3a31f01bb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e56916a-44c2-4479-afae-5c1f619a3d4a', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:14 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53247d42-3778-45de-82a1-7d86e485228c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:14 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Volume volume-2e56916a-44c2-4479-afae-5c1f619a3d4a (2e56916a-44c2-4479-afae-5c1f619a3d4a): created successfully
Jul 03 13:25:14 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53247d42-3778-45de-82a1-7d86e485228c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:14 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Flow 'volume_create_manager' (cef321f0-e57b-44f2-b9a6-19ff0e452def) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:25:14 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:14 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-410fde51-7320-429f-b093-4fc01a0e571b tempest-ProjectReaderTests-235125884 None] Created volume successfully.
Jul 03 13:25:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0807ce78-4ff1-4036-a940-a1e91dc2b85f tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3f5cf929-078c-483f-bc44-fee8540e97db" returned: 0 in 0.790s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0807ce78-4ff1-4036-a940-a1e91dc2b85f tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3f5cf929-078c-483f-bc44-fee8540e97db {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:14 devstack sudo[107898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3f5cf929-078c-483f-bc44-fee8540e97db
Jul 03 13:25:14 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-04970b0a-d0aa-4aa3-a4ce-e5ffcd45c6a3 tempest-ProjectReaderTests-235125884 None] Acquiring lock "cinder-2e56916a-44c2-4479-afae-5c1f619a3d4a-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:25:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-04970b0a-d0aa-4aa3-a4ce-e5ffcd45c6a3 tempest-ProjectReaderTests-235125884 None] Lock "cinder-2e56916a-44c2-4479-afae-5c1f619a3d4a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:25:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-04970b0a-d0aa-4aa3-a4ce-e5ffcd45c6a3 tempest-ProjectReaderTests-235125884 None] Acquiring lock "cinder-quobyte-2e56916a-44c2-4479-afae-5c1f619a3d4a" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:25:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-04970b0a-d0aa-4aa3-a4ce-e5ffcd45c6a3 tempest-ProjectReaderTests-235125884 None] Lock "cinder-quobyte-2e56916a-44c2-4479-afae-5c1f619a3d4a" acquired by "delete_volume" :: waited 0.015s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:25:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:25:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:25:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:25:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:15 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a849e6b-5819-4da5-a03c-113baae2da02]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:25:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-04970b0a-d0aa-4aa3-a4ce-e5ffcd45c6a3 tempest-ProjectReaderTests-235125884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2e56916a-44c2-4479-afae-5c1f619a3d4a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:15 devstack sudo[107900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:25:15 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:15 devstack sudo[107901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2e56916a-44c2-4479-afae-5c1f619a3d4a
Jul 03 13:25:15 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:15 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0807ce78-4ff1-4036-a940-a1e91dc2b85f tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3f5cf929-078c-483f-bc44-fee8540e97db" returned: 0 in 0.737s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:15 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0807ce78-4ff1-4036-a940-a1e91dc2b85f tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "cinder-quobyte-3f5cf929-078c-483f-bc44-fee8540e97db" released by "delete_volume" :: held 1.574s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:25:15 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-0807ce78-4ff1-4036-a940-a1e91dc2b85f tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Created reservations ['da66b5ae-b1e1-4faa-903d-3ca20e58da72', '236d799d-c6d4-4de8-83dd-ece35d88874f', '8739f2fc-6ee9-4029-9bc5-f41eec598c0c', 'de3b1556-4ff3-4122-a7f3-1be1a7cf3718'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:25:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0807ce78-4ff1-4036-a940-a1e91dc2b85f tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0807ce78-4ff1-4036-a940-a1e91dc2b85f tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:15 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0807ce78-4ff1-4036-a940-a1e91dc2b85f tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:25:15 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0807ce78-4ff1-4036-a940-a1e91dc2b85f tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:25:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0807ce78-4ff1-4036-a940-a1e91dc2b85f tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0807ce78-4ff1-4036-a940-a1e91dc2b85f tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:15 devstack sudo[107905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:25:15 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:15 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.695s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:15 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:25:15 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:25:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 28 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:25:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>, <Thread(tpool_thread_0, started daemon 134850092431040)>, <Thread(tpool_thread_1, started daemon 134850084021952)>, <Thread(tpool_thread_2, started daemon 134850075612864)>, <Thread(tpool_thread_3, started daemon 134850067203776)>, <Thread(tpool_thread_4, started daemon 134850058794688)>, <Thread(tpool_thread_5, started daemon 134850050385600)>, <Thread(tpool_thread_6, started daemon 134850041976512)>, <Thread(tpool_thread_7, started daemon 134850033567424)>, <Thread(tpool_thread_8, started daemon 134850025158336)>, <Thread(tpool_thread_9, started daemon 134850016749248)>, <Thread(tpool_thread_10, started daemon 134850008340160)>, <Thread(tpool_thread_11, started daemon 134849999931072)>, <Thread(tpool_thread_12, started daemon 134849991521984)>, <Thread(tpool_thread_13, started daemon 134849983112896)>, <Thread(tpool_thread_14, started daemon 134849974703808)>, <Thread(tpool_thread_15, started daemon 134849966294720)>, <Thread(tpool_thread_16, started daemon 134849957885632)>, <Thread(tpool_thread_17, started daemon 134849949476544)>, <Thread(tpool_thread_18, started daemon 134849941067456)>, <Thread(tpool_thread_19, started daemon 134849932658368)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:25:15 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-04970b0a-d0aa-4aa3-a4ce-e5ffcd45c6a3 tempest-ProjectReaderTests-235125884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2e56916a-44c2-4479-afae-5c1f619a3d4a" returned: 0 in 0.843s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-04970b0a-d0aa-4aa3-a4ce-e5ffcd45c6a3 tempest-ProjectReaderTests-235125884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2e56916a-44c2-4479-afae-5c1f619a3d4a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:15 devstack sudo[107911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2e56916a-44c2-4479-afae-5c1f619a3d4a
Jul 03 13:25:15 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:15 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f58bf108-5d11-47fc-836f-df5c25f84da5 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "cinder-4397861c-c6cf-4483-a322-2ff811518cd1-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:25:16 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f58bf108-5d11-47fc-836f-df5c25f84da5 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "cinder-4397861c-c6cf-4483-a322-2ff811518cd1-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:25:16 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f58bf108-5d11-47fc-836f-df5c25f84da5 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "cinder-quobyte-4397861c-c6cf-4483-a322-2ff811518cd1" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:25:16 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f58bf108-5d11-47fc-836f-df5c25f84da5 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "cinder-quobyte-4397861c-c6cf-4483-a322-2ff811518cd1" acquired by "delete_volume" :: waited 0.016s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:25:16 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[59dd57b3-1488-42f5-838b-ad332c0dec33]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:25:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f58bf108-5d11-47fc-836f-df5c25f84da5 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4397861c-c6cf-4483-a322-2ff811518cd1 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:16 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:16 devstack sudo[107914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4397861c-c6cf-4483-a322-2ff811518cd1
Jul 03 13:25:16 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0807ce78-4ff1-4036-a940-a1e91dc2b85f tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.735s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:16 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-0807ce78-4ff1-4036-a940-a1e91dc2b85f tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:25:16 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-0807ce78-4ff1-4036-a940-a1e91dc2b85f tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Deleted volume successfully.
Jul 03 13:25:16 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0807ce78-4ff1-4036-a940-a1e91dc2b85f tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "cinder-3f5cf929-078c-483f-bc44-fee8540e97db-delete_volume" released by "delete_volume" :: held 2.549s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:25:16 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-04970b0a-d0aa-4aa3-a4ce-e5ffcd45c6a3 tempest-ProjectReaderTests-235125884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2e56916a-44c2-4479-afae-5c1f619a3d4a" returned: 0 in 0.742s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:16 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-04970b0a-d0aa-4aa3-a4ce-e5ffcd45c6a3 tempest-ProjectReaderTests-235125884 None] Lock "cinder-quobyte-2e56916a-44c2-4479-afae-5c1f619a3d4a" released by "delete_volume" :: held 1.645s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:25:16 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-04970b0a-d0aa-4aa3-a4ce-e5ffcd45c6a3 tempest-ProjectReaderTests-235125884 None] Created reservations ['c76a6702-5ccc-4cf1-93ce-b7f5bad41c04', '556c46ef-4510-43cc-a34c-a2fee8ee024d', '3eadd282-507b-45b7-88d0-9cf1af58ac4d', 'a11fb439-0520-43a2-8c1f-88d6e39c0fd1'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:25:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-04970b0a-d0aa-4aa3-a4ce-e5ffcd45c6a3 tempest-ProjectReaderTests-235125884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-04970b0a-d0aa-4aa3-a4ce-e5ffcd45c6a3 tempest-ProjectReaderTests-235125884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:16 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-04970b0a-d0aa-4aa3-a4ce-e5ffcd45c6a3 tempest-ProjectReaderTests-235125884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:25:16 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-04970b0a-d0aa-4aa3-a4ce-e5ffcd45c6a3 tempest-ProjectReaderTests-235125884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:25:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-04970b0a-d0aa-4aa3-a4ce-e5ffcd45c6a3 tempest-ProjectReaderTests-235125884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-04970b0a-d0aa-4aa3-a4ce-e5ffcd45c6a3 tempest-ProjectReaderTests-235125884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:16 devstack sudo[107917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:25:16 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:16 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f58bf108-5d11-47fc-836f-df5c25f84da5 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4397861c-c6cf-4483-a322-2ff811518cd1" returned: 0 in 0.785s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f58bf108-5d11-47fc-836f-df5c25f84da5 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4397861c-c6cf-4483-a322-2ff811518cd1 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:16 devstack sudo[107922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4397861c-c6cf-4483-a322-2ff811518cd1
Jul 03 13:25:16 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:17 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-04970b0a-d0aa-4aa3-a4ce-e5ffcd45c6a3 tempest-ProjectReaderTests-235125884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.676s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:17 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-04970b0a-d0aa-4aa3-a4ce-e5ffcd45c6a3 tempest-ProjectReaderTests-235125884 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:25:17 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-04970b0a-d0aa-4aa3-a4ce-e5ffcd45c6a3 tempest-ProjectReaderTests-235125884 None] Deleted volume successfully.
Jul 03 13:25:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-04970b0a-d0aa-4aa3-a4ce-e5ffcd45c6a3 tempest-ProjectReaderTests-235125884 None] Lock "cinder-2e56916a-44c2-4479-afae-5c1f619a3d4a-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:25:17 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f58bf108-5d11-47fc-836f-df5c25f84da5 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-4397861c-c6cf-4483-a322-2ff811518cd1" returned: 0 in 0.740s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f58bf108-5d11-47fc-836f-df5c25f84da5 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "cinder-quobyte-4397861c-c6cf-4483-a322-2ff811518cd1" released by "delete_volume" :: held 1.565s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:25:17 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-f58bf108-5d11-47fc-836f-df5c25f84da5 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Created reservations ['17357816-d37b-4947-80ca-a9f1050a91e3', 'e675c2f0-b211-4c90-9b03-d032b13a9cb5', '027dc2ad-ff80-4989-ad56-d3f235e26201', '79b1fb38-39ab-41c3-9476-ab98a02e9aee'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:25:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f58bf108-5d11-47fc-836f-df5c25f84da5 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f58bf108-5d11-47fc-836f-df5c25f84da5 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:17 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f58bf108-5d11-47fc-836f-df5c25f84da5 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:25:17 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f58bf108-5d11-47fc-836f-df5c25f84da5 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:25:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f58bf108-5d11-47fc-836f-df5c25f84da5 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f58bf108-5d11-47fc-836f-df5c25f84da5 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:17 devstack sudo[107926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:25:17 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:18 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-01b2ae2c-c2d8-4d0e-babb-ecd4d5f1736b tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "cinder-b8962e3d-679b-4089-82d5-7a228a084507-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:25:18 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-01b2ae2c-c2d8-4d0e-babb-ecd4d5f1736b tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "cinder-b8962e3d-679b-4089-82d5-7a228a084507-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:25:18 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-01b2ae2c-c2d8-4d0e-babb-ecd4d5f1736b tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "cinder-quobyte-b8962e3d-679b-4089-82d5-7a228a084507" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:25:18 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-01b2ae2c-c2d8-4d0e-babb-ecd4d5f1736b tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "cinder-quobyte-b8962e3d-679b-4089-82d5-7a228a084507" acquired by "delete_volume" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:25:18 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d76491-7fa9-4524-a6e3-c363cfe0044d]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:25:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-01b2ae2c-c2d8-4d0e-babb-ecd4d5f1736b tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b8962e3d-679b-4089-82d5-7a228a084507 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:18 devstack sudo[107928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b8962e3d-679b-4089-82d5-7a228a084507
Jul 03 13:25:18 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:18 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f58bf108-5d11-47fc-836f-df5c25f84da5 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.804s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:18 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f58bf108-5d11-47fc-836f-df5c25f84da5 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:25:18 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-f58bf108-5d11-47fc-836f-df5c25f84da5 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Deleted volume successfully.
Jul 03 13:25:18 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-f58bf108-5d11-47fc-836f-df5c25f84da5 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "cinder-4397861c-c6cf-4483-a322-2ff811518cd1-delete_volume" released by "delete_volume" :: held 2.589s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:25:19 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-01b2ae2c-c2d8-4d0e-babb-ecd4d5f1736b tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b8962e3d-679b-4089-82d5-7a228a084507" returned: 0 in 0.941s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-01b2ae2c-c2d8-4d0e-babb-ecd4d5f1736b tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b8962e3d-679b-4089-82d5-7a228a084507 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:19 devstack sudo[107934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b8962e3d-679b-4089-82d5-7a228a084507
Jul 03 13:25:19 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:20 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-01b2ae2c-c2d8-4d0e-babb-ecd4d5f1736b tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b8962e3d-679b-4089-82d5-7a228a084507" returned: 0 in 0.651s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-01b2ae2c-c2d8-4d0e-babb-ecd4d5f1736b tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "cinder-quobyte-b8962e3d-679b-4089-82d5-7a228a084507" released by "delete_volume" :: held 1.647s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:25:20 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=160,cinder:UPDATE=214,cinder:INSERT=48,cinder:DELETE=18 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:25:20 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:UPDATE=231,cinder:SELECT=146,cinder:INSERT=58,cinder:DELETE=21 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:25:20 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-01b2ae2c-c2d8-4d0e-babb-ecd4d5f1736b tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Created reservations ['ff35604f-0f24-4206-98ae-0363cba61dbc', '1ce1233b-de19-412e-9c42-25a7172d311e', '09aa3df3-12f8-43c6-a5c1-7198edc90312', '867a8739-0d45-431d-a7b6-22ab1ffcc26e'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:25:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-01b2ae2c-c2d8-4d0e-babb-ecd4d5f1736b tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-01b2ae2c-c2d8-4d0e-babb-ecd4d5f1736b tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:20 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-01b2ae2c-c2d8-4d0e-babb-ecd4d5f1736b tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:25:20 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-01b2ae2c-c2d8-4d0e-babb-ecd4d5f1736b tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:25:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-01b2ae2c-c2d8-4d0e-babb-ecd4d5f1736b tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-01b2ae2c-c2d8-4d0e-babb-ecd4d5f1736b tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:20 devstack sudo[107937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:25:20 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ccd3be8c-1157-49d2-b4f8-2ef119f2b51e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "cinder-7719d227-2fc2-4f36-b256-4caf9a1521d1-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:25:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ccd3be8c-1157-49d2-b4f8-2ef119f2b51e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "cinder-7719d227-2fc2-4f36-b256-4caf9a1521d1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:25:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ccd3be8c-1157-49d2-b4f8-2ef119f2b51e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "cinder-quobyte-7719d227-2fc2-4f36-b256-4caf9a1521d1" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:25:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ccd3be8c-1157-49d2-b4f8-2ef119f2b51e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "cinder-quobyte-7719d227-2fc2-4f36-b256-4caf9a1521d1" acquired by "delete_volume" :: waited 0.023s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:25:20 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[434a4ea7-2c85-4084-b943-fb136c636544]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:25:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ccd3be8c-1157-49d2-b4f8-2ef119f2b51e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7719d227-2fc2-4f36-b256-4caf9a1521d1 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:20 devstack sudo[107939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7719d227-2fc2-4f36-b256-4caf9a1521d1
Jul 03 13:25:20 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:20 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-01b2ae2c-c2d8-4d0e-babb-ecd4d5f1736b tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.709s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:20 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-01b2ae2c-c2d8-4d0e-babb-ecd4d5f1736b tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:25:20 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-01b2ae2c-c2d8-4d0e-babb-ecd4d5f1736b tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Deleted volume successfully.
Jul 03 13:25:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-01b2ae2c-c2d8-4d0e-babb-ecd4d5f1736b tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "cinder-b8962e3d-679b-4089-82d5-7a228a084507-delete_volume" released by "delete_volume" :: held 2.611s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:25:21 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ccd3be8c-1157-49d2-b4f8-2ef119f2b51e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7719d227-2fc2-4f36-b256-4caf9a1521d1" returned: 0 in 0.760s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ccd3be8c-1157-49d2-b4f8-2ef119f2b51e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7719d227-2fc2-4f36-b256-4caf9a1521d1 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:21 devstack sudo[107945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7719d227-2fc2-4f36-b256-4caf9a1521d1
Jul 03 13:25:21 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:22 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ccd3be8c-1157-49d2-b4f8-2ef119f2b51e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-7719d227-2fc2-4f36-b256-4caf9a1521d1" returned: 0 in 0.769s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:22 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ccd3be8c-1157-49d2-b4f8-2ef119f2b51e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "cinder-quobyte-7719d227-2fc2-4f36-b256-4caf9a1521d1" released by "delete_volume" :: held 1.576s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:25:22 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-ccd3be8c-1157-49d2-b4f8-2ef119f2b51e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Created reservations ['9094f79c-489b-4d17-80a3-0420a59d14c6', '9379a363-dcc4-4445-936c-c2e09a4f9cb7', 'b53ab554-37d9-49e1-8591-0f28e17ec76e', '2a74802c-5c4e-46ab-b284-8583f74729de'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:25:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ccd3be8c-1157-49d2-b4f8-2ef119f2b51e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ccd3be8c-1157-49d2-b4f8-2ef119f2b51e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:22 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ccd3be8c-1157-49d2-b4f8-2ef119f2b51e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:25:22 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ccd3be8c-1157-49d2-b4f8-2ef119f2b51e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:25:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ccd3be8c-1157-49d2-b4f8-2ef119f2b51e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ccd3be8c-1157-49d2-b4f8-2ef119f2b51e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:22 devstack sudo[107948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:25:22 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:22 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7c958f4a-3038-4822-abbe-96eec08a7d22 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "cinder-e1a8900c-59ba-4b36-802a-6d15a59c51f3-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:25:22 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7c958f4a-3038-4822-abbe-96eec08a7d22 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "cinder-e1a8900c-59ba-4b36-802a-6d15a59c51f3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:25:22 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7c958f4a-3038-4822-abbe-96eec08a7d22 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "cinder-quobyte-e1a8900c-59ba-4b36-802a-6d15a59c51f3" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:25:22 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7c958f4a-3038-4822-abbe-96eec08a7d22 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "cinder-quobyte-e1a8900c-59ba-4b36-802a-6d15a59c51f3" acquired by "delete_volume" :: waited 0.020s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:25:22 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[b406e072-371c-4cc7-8086-248429ea3497]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:25:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7c958f4a-3038-4822-abbe-96eec08a7d22 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a8900c-59ba-4b36-802a-6d15a59c51f3 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:23 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ccd3be8c-1157-49d2-b4f8-2ef119f2b51e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.742s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:23 devstack sudo[107951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a8900c-59ba-4b36-802a-6d15a59c51f3
Jul 03 13:25:23 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:23 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-ccd3be8c-1157-49d2-b4f8-2ef119f2b51e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:25:23 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-ccd3be8c-1157-49d2-b4f8-2ef119f2b51e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Deleted volume successfully.
Jul 03 13:25:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ccd3be8c-1157-49d2-b4f8-2ef119f2b51e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "cinder-7719d227-2fc2-4f36-b256-4caf9a1521d1-delete_volume" released by "delete_volume" :: held 2.537s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:25:23 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7c958f4a-3038-4822-abbe-96eec08a7d22 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a8900c-59ba-4b36-802a-6d15a59c51f3" returned: 0 in 0.883s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7c958f4a-3038-4822-abbe-96eec08a7d22 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a8900c-59ba-4b36-802a-6d15a59c51f3 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:23 devstack sudo[107963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a8900c-59ba-4b36-802a-6d15a59c51f3
Jul 03 13:25:23 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:24 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7c958f4a-3038-4822-abbe-96eec08a7d22 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e1a8900c-59ba-4b36-802a-6d15a59c51f3" returned: 0 in 0.695s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7c958f4a-3038-4822-abbe-96eec08a7d22 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "cinder-quobyte-e1a8900c-59ba-4b36-802a-6d15a59c51f3" released by "delete_volume" :: held 1.622s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:25:24 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-7c958f4a-3038-4822-abbe-96eec08a7d22 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Created reservations ['5e03995d-8a24-4e2f-a23c-605baa78b703', '8a49ec25-1bf4-4424-9d6e-644ca00bc452', 'b8b219bf-cadd-41af-ac19-09c2ade8d0a4', '3b3dc581-02ca-4761-abf6-63ae3bf57cde'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:25:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-7c958f4a-3038-4822-abbe-96eec08a7d22 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-7c958f4a-3038-4822-abbe-96eec08a7d22 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-7c958f4a-3038-4822-abbe-96eec08a7d22 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:25:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-7c958f4a-3038-4822-abbe-96eec08a7d22 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:25:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-7c958f4a-3038-4822-abbe-96eec08a7d22 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7c958f4a-3038-4822-abbe-96eec08a7d22 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:24 devstack sudo[107966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:25:24 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-30b29455-9b1b-46ed-8bbd-816475d26e5e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "cinder-9dfaa53a-42e6-4ddf-88eb-94edf30eb9b1-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:25:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-30b29455-9b1b-46ed-8bbd-816475d26e5e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "cinder-9dfaa53a-42e6-4ddf-88eb-94edf30eb9b1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:25:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-30b29455-9b1b-46ed-8bbd-816475d26e5e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "cinder-quobyte-9dfaa53a-42e6-4ddf-88eb-94edf30eb9b1" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:25:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-30b29455-9b1b-46ed-8bbd-816475d26e5e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "cinder-quobyte-9dfaa53a-42e6-4ddf-88eb-94edf30eb9b1" acquired by "delete_volume" :: waited 0.017s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:25:25 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f62ba02-e613-4acb-96fe-d73eb644106a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:25:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-30b29455-9b1b-46ed-8bbd-816475d26e5e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9dfaa53a-42e6-4ddf-88eb-94edf30eb9b1 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:25 devstack sudo[107968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9dfaa53a-42e6-4ddf-88eb-94edf30eb9b1
Jul 03 13:25:25 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:25 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-7c958f4a-3038-4822-abbe-96eec08a7d22 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.706s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:25 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-7c958f4a-3038-4822-abbe-96eec08a7d22 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:25:25 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-7c958f4a-3038-4822-abbe-96eec08a7d22 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Deleted volume successfully.
Jul 03 13:25:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-7c958f4a-3038-4822-abbe-96eec08a7d22 tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "cinder-e1a8900c-59ba-4b36-802a-6d15a59c51f3-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:25:25 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-30b29455-9b1b-46ed-8bbd-816475d26e5e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9dfaa53a-42e6-4ddf-88eb-94edf30eb9b1" returned: 0 in 0.776s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-30b29455-9b1b-46ed-8bbd-816475d26e5e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9dfaa53a-42e6-4ddf-88eb-94edf30eb9b1 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:25 devstack sudo[107974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9dfaa53a-42e6-4ddf-88eb-94edf30eb9b1
Jul 03 13:25:25 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:26 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-30b29455-9b1b-46ed-8bbd-816475d26e5e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-9dfaa53a-42e6-4ddf-88eb-94edf30eb9b1" returned: 0 in 0.705s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:26 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-30b29455-9b1b-46ed-8bbd-816475d26e5e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "cinder-quobyte-9dfaa53a-42e6-4ddf-88eb-94edf30eb9b1" released by "delete_volume" :: held 1.526s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:25:26 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-30b29455-9b1b-46ed-8bbd-816475d26e5e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Created reservations ['1f628dff-626a-49e4-98d2-435ad8432b41', '55d09410-7de2-454a-bddc-daf82505bda1', '3c5fb376-ede7-40a2-a330-493617c55654', 'f511691e-79e0-4c60-a8d3-0c33c912c699'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:25:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-30b29455-9b1b-46ed-8bbd-816475d26e5e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-30b29455-9b1b-46ed-8bbd-816475d26e5e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-30b29455-9b1b-46ed-8bbd-816475d26e5e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:25:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-30b29455-9b1b-46ed-8bbd-816475d26e5e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:25:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-30b29455-9b1b-46ed-8bbd-816475d26e5e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-30b29455-9b1b-46ed-8bbd-816475d26e5e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:26 devstack sudo[108013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:25:26 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:27 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-30b29455-9b1b-46ed-8bbd-816475d26e5e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.643s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:27 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-30b29455-9b1b-46ed-8bbd-816475d26e5e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:25:27 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-30b29455-9b1b-46ed-8bbd-816475d26e5e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Deleted volume successfully.
Jul 03 13:25:27 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-30b29455-9b1b-46ed-8bbd-816475d26e5e tempest-CreateVolumesFromSourceVolumeTest-693070371 None] Lock "cinder-9dfaa53a-42e6-4ddf-88eb-94edf30eb9b1-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:25:35 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:25:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Flow 'volume_create_manager' (3ebf8d89-5637-4bbf-94b5-6047a472fa43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:25:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f273f4-dff3-49ec-9827-8c704daca556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f273f4-dff3-49ec-9827-8c704daca556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-696201031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f25739-c328-48f3-a983-16bd0792b0cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8d4fe10f484b91aa1fc4422b05cde7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:25:35Z,use_quota=True,user_id='2b582c4b94f7429ab6e89182333ff8a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866cd1a2-5020-4f6d-8160-fbb5fdcec1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866cd1a2-5020-4f6d-8160-fbb5fdcec1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e68f417-9370-4d16-8916-30871f8e1afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e68f417-9370-4d16-8916-30871f8e1afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25f25739-c328-48f3-a983-16bd0792b0cf', 'volume_name': 'volume-25f25739-c328-48f3-a983-16bd0792b0cf', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d7200f8-715d-49d6-8f94-cfae5cfab6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d7200f8-715d-49d6-8f94-cfae5cfab6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:35 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a1db27-9bd0-4bc7-aaa3-24eb2fd35662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:35 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Volume 25f25739-c328-48f3-a983-16bd0792b0cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25f25739-c328-48f3-a983-16bd0792b0cf', 'volume_size': 1}
Jul 03 13:25:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-696201031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f25739-c328-48f3-a983-16bd0792b0cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8d4fe10f484b91aa1fc4422b05cde7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:25:35Z,use_quota=True,user_id='2b582c4b94f7429ab6e89182333ff8a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:25:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Creating volume 25f25739-c328-48f3-a983-16bd0792b0cf {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:25:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:25:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:25:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:25:35 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:25:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:35 devstack sudo[108018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf 1073741824
Jul 03 13:25:35 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:36 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf 1073741824" returned: 0 in 0.822s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:36 devstack sudo[108024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf
Jul 03 13:25:36 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:36 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf" returned: 0 in 0.644s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:25:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a1db27-9bd0-4bc7-aaa3-24eb2fd35662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25f25739-c328-48f3-a983-16bd0792b0cf', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d007a8b-6ba1-4e68-941e-8ab415d4c014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:36 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Volume volume-25f25739-c328-48f3-a983-16bd0792b0cf (25f25739-c328-48f3-a983-16bd0792b0cf): created successfully
Jul 03 13:25:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d007a8b-6ba1-4e68-941e-8ab415d4c014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Flow 'volume_create_manager' (3ebf8d89-5637-4bbf-94b5-6047a472fa43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:25:36 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-088e8f79-817c-48d3-8bea-48cf7610bbb9 tempest-ProjectMemberTests-1669144745 None] Created volume successfully.
Jul 03 13:25:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4e0ae62f-9e81-4d00-a469-626d6ab114ec tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4e0ae62f-9e81-4d00-a469-626d6ab114ec tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-4e0ae62f-9e81-4d00-a469-626d6ab114ec tempest-ProjectMemberTests-1669144745 None] Creating offline snapshot 60b5d4ce-98b9-49a0-b605-08874fd27640 of volume 25f25739-c328-48f3-a983-16bd0792b0cf {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:25:37 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24c4bc9-a970-4384-8efd-468da4d05432]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:25:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4e0ae62f-9e81-4d00-a469-626d6ab114ec tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:37 devstack sudo[108027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf
Jul 03 13:25:37 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:38 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4e0ae62f-9e81-4d00-a469-626d6ab114ec tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf" returned: 0 in 0.758s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4e0ae62f-9e81-4d00-a469-626d6ab114ec tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf.60b5d4ce-98b9-49a0-b605-08874fd27640 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:38 devstack sudo[108033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf.60b5d4ce-98b9-49a0-b605-08874fd27640 1G
Jul 03 13:25:38 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:39 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4e0ae62f-9e81-4d00-a469-626d6ab114ec tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf.60b5d4ce-98b9-49a0-b605-08874fd27640 1G" returned: 0 in 0.804s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4e0ae62f-9e81-4d00-a469-626d6ab114ec tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25f25739-c328-48f3-a983-16bd0792b0cf -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf.60b5d4ce-98b9-49a0-b605-08874fd27640 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:39 devstack sudo[108038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25f25739-c328-48f3-a983-16bd0792b0cf -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf.60b5d4ce-98b9-49a0-b605-08874fd27640
Jul 03 13:25:39 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:39 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4e0ae62f-9e81-4d00-a469-626d6ab114ec tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25f25739-c328-48f3-a983-16bd0792b0cf -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf.60b5d4ce-98b9-49a0-b605-08874fd27640" returned: 0 in 0.695s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:39 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-4e0ae62f-9e81-4d00-a469-626d6ab114ec tempest-ProjectMemberTests-1669144745 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf.60b5d4ce-98b9-49a0-b605-08874fd27640 is being set with open permissions: ugo+rw
Jul 03 13:25:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4e0ae62f-9e81-4d00-a469-626d6ab114ec tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf.60b5d4ce-98b9-49a0-b605-08874fd27640 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:39 devstack sudo[108043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf.60b5d4ce-98b9-49a0-b605-08874fd27640
Jul 03 13:25:39 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:40 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4e0ae62f-9e81-4d00-a469-626d6ab114ec tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf.60b5d4ce-98b9-49a0-b605-08874fd27640" returned: 0 in 0.667s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4e0ae62f-9e81-4d00-a469-626d6ab114ec tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:40 devstack sudo[108046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf.info
Jul 03 13:25:40 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:41 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4e0ae62f-9e81-4d00-a469-626d6ab114ec tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf.info" returned: 0 in 0.635s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:41 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-4e0ae62f-9e81-4d00-a469-626d6ab114ec tempest-ProjectMemberTests-1669144745 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf.info is being set with open permissions: ugo+rw
Jul 03 13:25:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4e0ae62f-9e81-4d00-a469-626d6ab114ec tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:41 devstack sudo[108049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf.info
Jul 03 13:25:41 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:41 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4e0ae62f-9e81-4d00-a469-626d6ab114ec tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf.info" returned: 0 in 0.636s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4e0ae62f-9e81-4d00-a469-626d6ab114ec tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.280s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:41 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-4e0ae62f-9e81-4d00-a469-626d6ab114ec tempest-ProjectMemberTests-1669144745 None] Create snapshot completed successfully
Jul 03 13:25:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5b1184d6-134a-49e7-b478-0604288eaa81 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-60b5d4ce-98b9-49a0-b605-08874fd27640-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:25:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5b1184d6-134a-49e7-b478-0604288eaa81 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-60b5d4ce-98b9-49a0-b605-08874fd27640-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:25:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5b1184d6-134a-49e7-b478-0604288eaa81 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-quobyte-25f25739-c328-48f3-a983-16bd0792b0cf" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:25:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5b1184d6-134a-49e7-b478-0604288eaa81 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-25f25739-c328-48f3-a983-16bd0792b0cf" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:25:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5b1184d6-134a-49e7-b478-0604288eaa81 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-quobyte-60b5d4ce-98b9-49a0-b605-08874fd27640" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:25:42 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5b1184d6-134a-49e7-b478-0604288eaa81 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-60b5d4ce-98b9-49a0-b605-08874fd27640" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:25:42 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-5b1184d6-134a-49e7-b478-0604288eaa81 tempest-ProjectMemberTests-1669144745 None] Deleting offline snapshot 60b5d4ce-98b9-49a0-b605-08874fd27640 of volume 25f25739-c328-48f3-a983-16bd0792b0cf {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:25:42 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-5b1184d6-134a-49e7-b478-0604288eaa81 tempest-ProjectMemberTests-1669144745 None] snapshot_file for this snap is: volume-25f25739-c328-48f3-a983-16bd0792b0cf.60b5d4ce-98b9-49a0-b605-08874fd27640 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:25:42 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cdb8f6-d761-48c6-b155-d995cfe65905]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:25:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5b1184d6-134a-49e7-b478-0604288eaa81 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf.60b5d4ce-98b9-49a0-b605-08874fd27640 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:42 devstack sudo[108052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf.60b5d4ce-98b9-49a0-b605-08874fd27640
Jul 03 13:25:42 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:43 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5b1184d6-134a-49e7-b478-0604288eaa81 tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf.60b5d4ce-98b9-49a0-b605-08874fd27640" returned: 0 in 0.760s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:43 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-5b1184d6-134a-49e7-b478-0604288eaa81 tempest-ProjectMemberTests-1669144745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25f25739-c328-48f3-a983-16bd0792b0cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:25:43 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ace48e4-b242-4143-baa0-0836aa209737]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:25:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5b1184d6-134a-49e7-b478-0604288eaa81 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:43 devstack sudo[108058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf
Jul 03 13:25:43 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:44 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5b1184d6-134a-49e7-b478-0604288eaa81 tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf" returned: 0 in 0.749s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5b1184d6-134a-49e7-b478-0604288eaa81 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf.60b5d4ce-98b9-49a0-b605-08874fd27640 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:44 devstack sudo[108063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf.60b5d4ce-98b9-49a0-b605-08874fd27640
Jul 03 13:25:44 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:45 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5b1184d6-134a-49e7-b478-0604288eaa81 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf.60b5d4ce-98b9-49a0-b605-08874fd27640" returned: 0 in 0.702s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5b1184d6-134a-49e7-b478-0604288eaa81 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf.60b5d4ce-98b9-49a0-b605-08874fd27640 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:45 devstack sudo[108068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf.60b5d4ce-98b9-49a0-b605-08874fd27640
Jul 03 13:25:45 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:45 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5b1184d6-134a-49e7-b478-0604288eaa81 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf.60b5d4ce-98b9-49a0-b605-08874fd27640" returned: 0 in 0.670s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5b1184d6-134a-49e7-b478-0604288eaa81 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-60b5d4ce-98b9-49a0-b605-08874fd27640" released by "_delete_snapshot" :: held 2.979s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:25:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5b1184d6-134a-49e7-b478-0604288eaa81 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-25f25739-c328-48f3-a983-16bd0792b0cf" released by "delete_snapshot" :: held 3.002s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:25:45 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-5b1184d6-134a-49e7-b478-0604288eaa81 tempest-ProjectMemberTests-1669144745 None] Created reservations ['57f4a30d-5fe8-419a-90ff-70ae8ff73977', '7a5c1679-cc70-4ec5-aec9-eae65e07d81a', '9eb664bb-595d-4aa1-9d10-d5e257276904', '8b53a197-de68-4fca-8d32-60e748bd4706'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:25:45 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-5b1184d6-134a-49e7-b478-0604288eaa81 tempest-ProjectMemberTests-1669144745 None] Delete snapshot completed successfully.
Jul 03 13:25:45 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-5b1184d6-134a-49e7-b478-0604288eaa81 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-60b5d4ce-98b9-49a0-b605-08874fd27640-delete_snapshot" released by "delete_snapshot" :: held 3.149s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:25:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-06689e57-de3d-4579-a2d6-6e755964cf0a tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-25f25739-c328-48f3-a983-16bd0792b0cf-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:25:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-06689e57-de3d-4579-a2d6-6e755964cf0a tempest-ProjectMemberTests-1669144745 None] Lock "cinder-25f25739-c328-48f3-a983-16bd0792b0cf-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:25:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-06689e57-de3d-4579-a2d6-6e755964cf0a tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-quobyte-25f25739-c328-48f3-a983-16bd0792b0cf" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:25:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-06689e57-de3d-4579-a2d6-6e755964cf0a tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-25f25739-c328-48f3-a983-16bd0792b0cf" acquired by "delete_volume" :: waited 0.014s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:25:47 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3169f3c4-3b7b-4a77-8dbe-660d010d122a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:25:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-06689e57-de3d-4579-a2d6-6e755964cf0a tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:47 devstack sudo[108071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf
Jul 03 13:25:47 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:47 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-06689e57-de3d-4579-a2d6-6e755964cf0a tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf" returned: 0 in 0.725s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-06689e57-de3d-4579-a2d6-6e755964cf0a tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:47 devstack sudo[108076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf
Jul 03 13:25:47 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:48 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-06689e57-de3d-4579-a2d6-6e755964cf0a tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-25f25739-c328-48f3-a983-16bd0792b0cf" returned: 0 in 0.620s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:48 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-06689e57-de3d-4579-a2d6-6e755964cf0a tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-25f25739-c328-48f3-a983-16bd0792b0cf" released by "delete_volume" :: held 1.400s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:25:48 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-06689e57-de3d-4579-a2d6-6e755964cf0a tempest-ProjectMemberTests-1669144745 None] Created reservations ['e1525481-c1f0-4cad-98e1-1c3fb2c68b66', '465e05f7-d6ec-4935-83c2-900d12171f7f', 'f2969daa-e82a-440d-a08f-a4edb7cab293', '003028d2-8fbe-4bc6-bffb-15a293dc4722'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:25:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-06689e57-de3d-4579-a2d6-6e755964cf0a tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-06689e57-de3d-4579-a2d6-6e755964cf0a tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:48 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-06689e57-de3d-4579-a2d6-6e755964cf0a tempest-ProjectMemberTests-1669144745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:25:48 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-06689e57-de3d-4579-a2d6-6e755964cf0a tempest-ProjectMemberTests-1669144745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:25:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-06689e57-de3d-4579-a2d6-6e755964cf0a tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-06689e57-de3d-4579-a2d6-6e755964cf0a tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:48 devstack sudo[108079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:25:48 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:49 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-06689e57-de3d-4579-a2d6-6e755964cf0a tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.676s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:49 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-06689e57-de3d-4579-a2d6-6e755964cf0a tempest-ProjectMemberTests-1669144745 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:25:49 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-06689e57-de3d-4579-a2d6-6e755964cf0a tempest-ProjectMemberTests-1669144745 None] Deleted volume successfully.
Jul 03 13:25:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-06689e57-de3d-4579-a2d6-6e755964cf0a tempest-ProjectMemberTests-1669144745 None] Lock "cinder-25f25739-c328-48f3-a983-16bd0792b0cf-delete_volume" released by "delete_volume" :: held 2.277s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:25:49 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:25:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Flow 'volume_create_manager' (4e826d30-de4f-4c14-b623-12493cf8a9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:25:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f198b95-c00e-4c0c-b357-643d659ee42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f198b95-c00e-4c0c-b357-643d659ee42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-848478928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a32cb01-108f-4a1c-b51c-d40b22ad33db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8d4fe10f484b91aa1fc4422b05cde7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:25:50Z,use_quota=True,user_id='2b582c4b94f7429ab6e89182333ff8a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc8cba70-f010-462b-9cce-28562da51fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc8cba70-f010-462b-9cce-28562da51fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61314d19-3d9a-44a6-ad34-d1d67caa6591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61314d19-3d9a-44a6-ad34-d1d67caa6591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a32cb01-108f-4a1c-b51c-d40b22ad33db', 'volume_name': 'volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e55e2c-210e-4670-87f9-468f684b09a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e55e2c-210e-4670-87f9-468f684b09a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:49 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab40480-af0b-41a6-8f18-d52121a94bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:49 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Volume 3a32cb01-108f-4a1c-b51c-d40b22ad33db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db', 'volume_size': 1}
Jul 03 13:25:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-848478928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a32cb01-108f-4a1c-b51c-d40b22ad33db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8d4fe10f484b91aa1fc4422b05cde7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:25:50Z,use_quota=True,user_id='2b582c4b94f7429ab6e89182333ff8a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:25:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Creating volume 3a32cb01-108f-4a1c-b51c-d40b22ad33db {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:25:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:25:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:25:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:25:49 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:25:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:49 devstack sudo[108082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db 1073741824
Jul 03 13:25:49 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:50 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db 1073741824" returned: 0 in 0.848s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:50 devstack sudo[108087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db
Jul 03 13:25:50 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:51 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db" returned: 0 in 0.637s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:25:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab40480-af0b-41a6-8f18-d52121a94bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cad5d4a-8c3a-4445-8385-7e854e153438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:25:51 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Volume volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db (3a32cb01-108f-4a1c-b51c-d40b22ad33db): created successfully
Jul 03 13:25:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cad5d4a-8c3a-4445-8385-7e854e153438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:25:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Flow 'volume_create_manager' (4e826d30-de4f-4c14-b623-12493cf8a9f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:25:51 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-15eb6325-5410-486c-89e8-cae77ff61384 tempest-ProjectMemberTests-1669144745 None] Created volume successfully.
Jul 03 13:25:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-fb9e3bbf-858e-491f-b413-063c30881574 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:25:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-fb9e3bbf-858e-491f-b413-063c30881574 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:25:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-fb9e3bbf-858e-491f-b413-063c30881574 tempest-ProjectMemberTests-1669144745 None] Creating offline snapshot 46e4f6a3-ce3a-4861-9078-747b74aa1b2f of volume 3a32cb01-108f-4a1c-b51c-d40b22ad33db {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:25:51 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c7cf94-1c80-4ea9-8b57-1037c101c20a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:25:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fb9e3bbf-858e-491f-b413-063c30881574 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:52 devstack sudo[108090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db
Jul 03 13:25:52 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:52 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fb9e3bbf-858e-491f-b413-063c30881574 tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db" returned: 0 in 0.751s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fb9e3bbf-858e-491f-b413-063c30881574 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db.46e4f6a3-ce3a-4861-9078-747b74aa1b2f 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:52 devstack sudo[108096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db.46e4f6a3-ce3a-4861-9078-747b74aa1b2f 1G
Jul 03 13:25:52 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:53 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fb9e3bbf-858e-491f-b413-063c30881574 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db.46e4f6a3-ce3a-4861-9078-747b74aa1b2f 1G" returned: 0 in 0.822s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fb9e3bbf-858e-491f-b413-063c30881574 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db.46e4f6a3-ce3a-4861-9078-747b74aa1b2f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:53 devstack sudo[108102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db.46e4f6a3-ce3a-4861-9078-747b74aa1b2f
Jul 03 13:25:53 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:54 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fb9e3bbf-858e-491f-b413-063c30881574 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db.46e4f6a3-ce3a-4861-9078-747b74aa1b2f" returned: 0 in 0.703s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:54 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-fb9e3bbf-858e-491f-b413-063c30881574 tempest-ProjectMemberTests-1669144745 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db.46e4f6a3-ce3a-4861-9078-747b74aa1b2f is being set with open permissions: ugo+rw
Jul 03 13:25:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fb9e3bbf-858e-491f-b413-063c30881574 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db.46e4f6a3-ce3a-4861-9078-747b74aa1b2f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:54 devstack sudo[108107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db.46e4f6a3-ce3a-4861-9078-747b74aa1b2f
Jul 03 13:25:54 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:54 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fb9e3bbf-858e-491f-b413-063c30881574 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db.46e4f6a3-ce3a-4861-9078-747b74aa1b2f" returned: 0 in 0.623s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fb9e3bbf-858e-491f-b413-063c30881574 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:54 devstack sudo[108110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db.info
Jul 03 13:25:54 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:55 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fb9e3bbf-858e-491f-b413-063c30881574 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db.info" returned: 0 in 0.681s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:55 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-fb9e3bbf-858e-491f-b413-063c30881574 tempest-ProjectMemberTests-1669144745 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db.info is being set with open permissions: ugo+rw
Jul 03 13:25:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fb9e3bbf-858e-491f-b413-063c30881574 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:55 devstack sudo[108113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db.info
Jul 03 13:25:55 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:56 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-fb9e3bbf-858e-491f-b413-063c30881574 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db.info" returned: 0 in 0.673s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-fb9e3bbf-858e-491f-b413-063c30881574 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.344s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:25:56 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-fb9e3bbf-858e-491f-b413-063c30881574 tempest-ProjectMemberTests-1669144745 None] Create snapshot completed successfully
Jul 03 13:25:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-57ea4cbb-e030-47b7-9994-4ef271a8fe53 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-46e4f6a3-ce3a-4861-9078-747b74aa1b2f-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:25:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-57ea4cbb-e030-47b7-9994-4ef271a8fe53 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-46e4f6a3-ce3a-4861-9078-747b74aa1b2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:25:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-57ea4cbb-e030-47b7-9994-4ef271a8fe53 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-quobyte-3a32cb01-108f-4a1c-b51c-d40b22ad33db" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:25:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-57ea4cbb-e030-47b7-9994-4ef271a8fe53 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-3a32cb01-108f-4a1c-b51c-d40b22ad33db" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:25:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-57ea4cbb-e030-47b7-9994-4ef271a8fe53 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-quobyte-46e4f6a3-ce3a-4861-9078-747b74aa1b2f" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:25:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-57ea4cbb-e030-47b7-9994-4ef271a8fe53 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-46e4f6a3-ce3a-4861-9078-747b74aa1b2f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:25:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-57ea4cbb-e030-47b7-9994-4ef271a8fe53 tempest-ProjectMemberTests-1669144745 None] Deleting offline snapshot 46e4f6a3-ce3a-4861-9078-747b74aa1b2f of volume 3a32cb01-108f-4a1c-b51c-d40b22ad33db {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:25:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-57ea4cbb-e030-47b7-9994-4ef271a8fe53 tempest-ProjectMemberTests-1669144745 None] snapshot_file for this snap is: volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db.46e4f6a3-ce3a-4861-9078-747b74aa1b2f {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:25:57 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b7a9a5-7495-4d4a-9150-287f2e35f1d7]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:25:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-57ea4cbb-e030-47b7-9994-4ef271a8fe53 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db.46e4f6a3-ce3a-4861-9078-747b74aa1b2f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:57 devstack sudo[108117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db.46e4f6a3-ce3a-4861-9078-747b74aa1b2f
Jul 03 13:25:57 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:57 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-57ea4cbb-e030-47b7-9994-4ef271a8fe53 tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db.46e4f6a3-ce3a-4861-9078-747b74aa1b2f" returned: 0 in 0.814s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-57ea4cbb-e030-47b7-9994-4ef271a8fe53 tempest-ProjectMemberTests-1669144745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:25:58 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[867ebd19-ba48-4369-881d-8251c366808a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:25:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-57ea4cbb-e030-47b7-9994-4ef271a8fe53 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:58 devstack sudo[108123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db
Jul 03 13:25:58 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:58 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-57ea4cbb-e030-47b7-9994-4ef271a8fe53 tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db" returned: 0 in 0.770s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-57ea4cbb-e030-47b7-9994-4ef271a8fe53 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db.46e4f6a3-ce3a-4861-9078-747b74aa1b2f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:58 devstack sudo[108128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db.46e4f6a3-ce3a-4861-9078-747b74aa1b2f
Jul 03 13:25:58 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:25:59 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root
Jul 03 13:25:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-57ea4cbb-e030-47b7-9994-4ef271a8fe53 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db.46e4f6a3-ce3a-4861-9078-747b74aa1b2f" returned: 0 in 0.753s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:25:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-57ea4cbb-e030-47b7-9994-4ef271a8fe53 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db.46e4f6a3-ce3a-4861-9078-747b74aa1b2f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:25:59 devstack sudo[108134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db.46e4f6a3-ce3a-4861-9078-747b74aa1b2f
Jul 03 13:25:59 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:00 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-57ea4cbb-e030-47b7-9994-4ef271a8fe53 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db.46e4f6a3-ce3a-4861-9078-747b74aa1b2f" returned: 0 in 0.657s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:00 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-57ea4cbb-e030-47b7-9994-4ef271a8fe53 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-46e4f6a3-ce3a-4861-9078-747b74aa1b2f" released by "_delete_snapshot" :: held 3.102s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:26:00 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-57ea4cbb-e030-47b7-9994-4ef271a8fe53 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-3a32cb01-108f-4a1c-b51c-d40b22ad33db" released by "delete_snapshot" :: held 3.125s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:26:00 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-57ea4cbb-e030-47b7-9994-4ef271a8fe53 tempest-ProjectMemberTests-1669144745 None] Created reservations ['38a1fe0d-fa1d-4c34-b40a-640209edb42e', '883ab0f7-5382-4ae4-89cd-c81632e6930f', '1dcedb04-b565-4dd0-86a1-10109a58c806', '6f330c37-76b6-44b4-94bb-74553d20bc72'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:26:00 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-57ea4cbb-e030-47b7-9994-4ef271a8fe53 tempest-ProjectMemberTests-1669144745 None] Delete snapshot completed successfully.
Jul 03 13:26:00 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-57ea4cbb-e030-47b7-9994-4ef271a8fe53 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-46e4f6a3-ce3a-4861-9078-747b74aa1b2f-delete_snapshot" released by "delete_snapshot" :: held 3.267s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:26:01 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-85cb2555-f4e4-4c2b-ab6f-9400c17fddea tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-3a32cb01-108f-4a1c-b51c-d40b22ad33db-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:26:01 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-85cb2555-f4e4-4c2b-ab6f-9400c17fddea tempest-ProjectMemberTests-1669144745 None] Lock "cinder-3a32cb01-108f-4a1c-b51c-d40b22ad33db-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:26:01 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-85cb2555-f4e4-4c2b-ab6f-9400c17fddea tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-quobyte-3a32cb01-108f-4a1c-b51c-d40b22ad33db" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:26:01 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-85cb2555-f4e4-4c2b-ab6f-9400c17fddea tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-3a32cb01-108f-4a1c-b51c-d40b22ad33db" acquired by "delete_volume" :: waited 0.016s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:26:01 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a631d4d8-a36b-472f-bff5-4434cd115081]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:26:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-85cb2555-f4e4-4c2b-ab6f-9400c17fddea tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:01 devstack sudo[108139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db
Jul 03 13:26:01 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:02 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-85cb2555-f4e4-4c2b-ab6f-9400c17fddea tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db" returned: 0 in 0.833s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-85cb2555-f4e4-4c2b-ab6f-9400c17fddea tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:02 devstack sudo[108144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db
Jul 03 13:26:02 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:02 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-85cb2555-f4e4-4c2b-ab6f-9400c17fddea tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-3a32cb01-108f-4a1c-b51c-d40b22ad33db" returned: 0 in 0.672s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:03 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-85cb2555-f4e4-4c2b-ab6f-9400c17fddea tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-3a32cb01-108f-4a1c-b51c-d40b22ad33db" released by "delete_volume" :: held 1.566s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:26:03 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-85cb2555-f4e4-4c2b-ab6f-9400c17fddea tempest-ProjectMemberTests-1669144745 None] Created reservations ['6e655708-efb1-473d-9b50-90da095cb56c', '6ac32567-b5f1-4e24-b5bf-89769089c748', 'a471f34e-8cb5-4c25-8e36-fc2b7e865369', '5ee54f65-29b4-46fb-b3c0-1dfc7f406793'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:26:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-85cb2555-f4e4-4c2b-ab6f-9400c17fddea tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:26:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-85cb2555-f4e4-4c2b-ab6f-9400c17fddea tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:26:03 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-85cb2555-f4e4-4c2b-ab6f-9400c17fddea tempest-ProjectMemberTests-1669144745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:26:03 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-85cb2555-f4e4-4c2b-ab6f-9400c17fddea tempest-ProjectMemberTests-1669144745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:26:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-85cb2555-f4e4-4c2b-ab6f-9400c17fddea tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:26:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-85cb2555-f4e4-4c2b-ab6f-9400c17fddea tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:03 devstack sudo[108147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:26:03 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:03 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-85cb2555-f4e4-4c2b-ab6f-9400c17fddea tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.712s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:03 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-85cb2555-f4e4-4c2b-ab6f-9400c17fddea tempest-ProjectMemberTests-1669144745 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:26:03 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-85cb2555-f4e4-4c2b-ab6f-9400c17fddea tempest-ProjectMemberTests-1669144745 None] Deleted volume successfully.
Jul 03 13:26:03 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-85cb2555-f4e4-4c2b-ab6f-9400c17fddea tempest-ProjectMemberTests-1669144745 None] Lock "cinder-3a32cb01-108f-4a1c-b51c-d40b22ad33db-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:26:04 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:26:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Flow 'volume_create_manager' (7bd778ad-16e3-47fd-b5b6-9341a1c476b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:26:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986b58de-6f59-4e9d-b883-bf29a4ae363c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:26:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986b58de-6f59-4e9d-b883-bf29a4ae363c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1925050584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26926bb3-1f72-42d2-8490-1f1625579ec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8d4fe10f484b91aa1fc4422b05cde7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:26:04Z,use_quota=True,user_id='2b582c4b94f7429ab6e89182333ff8a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:26:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7224f8e2-4020-466d-b590-08bd30405e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:26:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7224f8e2-4020-466d-b590-08bd30405e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:26:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a67787a0-9d5c-4867-a31d-c427d584f8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:26:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a67787a0-9d5c-4867-a31d-c427d584f8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26926bb3-1f72-42d2-8490-1f1625579ec4', 'volume_name': 'volume-26926bb3-1f72-42d2-8490-1f1625579ec4', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:26:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (333192e0-e89a-4f94-b29a-5ffa0ae88958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:26:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (333192e0-e89a-4f94-b29a-5ffa0ae88958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:26:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9988015f-33d5-42c7-9cca-906f8e41a180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:26:04 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Volume 26926bb3-1f72-42d2-8490-1f1625579ec4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26926bb3-1f72-42d2-8490-1f1625579ec4', 'volume_size': 1}
Jul 03 13:26:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:26:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:26:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1925050584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26926bb3-1f72-42d2-8490-1f1625579ec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8d4fe10f484b91aa1fc4422b05cde7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:26:04Z,use_quota=True,user_id='2b582c4b94f7429ab6e89182333ff8a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:26:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Creating volume 26926bb3-1f72-42d2-8490-1f1625579ec4 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:26:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:26:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:26:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:26:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:26:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:26:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:26:04 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:26:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:04 devstack sudo[108151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4 1073741824
Jul 03 13:26:04 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:05 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4 1073741824" returned: 0 in 0.832s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:05 devstack sudo[108156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4
Jul 03 13:26:05 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:05 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4" returned: 0 in 0.653s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:05 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:26:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:26:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9988015f-33d5-42c7-9cca-906f8e41a180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26926bb3-1f72-42d2-8490-1f1625579ec4', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:26:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e6fe99c-a262-40dc-a11a-660476f32063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:26:05 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Volume volume-26926bb3-1f72-42d2-8490-1f1625579ec4 (26926bb3-1f72-42d2-8490-1f1625579ec4): created successfully
Jul 03 13:26:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e6fe99c-a262-40dc-a11a-660476f32063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:26:05 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Flow 'volume_create_manager' (7bd778ad-16e3-47fd-b5b6-9341a1c476b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:26:05 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-594c31d4-efcc-4c07-96c8-4f84e87414f0 tempest-ProjectMemberTests-1669144745 None] Created volume successfully.
Jul 03 13:26:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-95522a1a-f49d-414f-b74f-9f8844d05829 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:26:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-95522a1a-f49d-414f-b74f-9f8844d05829 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:26:06 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-95522a1a-f49d-414f-b74f-9f8844d05829 tempest-ProjectMemberTests-1669144745 None] Creating offline snapshot 18119309-23b2-433f-8db7-28f51a3d3b75 of volume 26926bb3-1f72-42d2-8490-1f1625579ec4 {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:26:06 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b64bc4-0c44-4f5e-9258-e5be92a1b78e]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:26:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-95522a1a-f49d-414f-b74f-9f8844d05829 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:06 devstack sudo[108159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4
Jul 03 13:26:06 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:07 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-95522a1a-f49d-414f-b74f-9f8844d05829 tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4" returned: 0 in 0.844s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-95522a1a-f49d-414f-b74f-9f8844d05829 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4.18119309-23b2-433f-8db7-28f51a3d3b75 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:07 devstack sudo[108164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4.18119309-23b2-433f-8db7-28f51a3d3b75 1G
Jul 03 13:26:07 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:08 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-95522a1a-f49d-414f-b74f-9f8844d05829 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4.18119309-23b2-433f-8db7-28f51a3d3b75 1G" returned: 0 in 0.899s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-95522a1a-f49d-414f-b74f-9f8844d05829 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26926bb3-1f72-42d2-8490-1f1625579ec4 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4.18119309-23b2-433f-8db7-28f51a3d3b75 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:08 devstack sudo[108171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26926bb3-1f72-42d2-8490-1f1625579ec4 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4.18119309-23b2-433f-8db7-28f51a3d3b75
Jul 03 13:26:08 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:08 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-95522a1a-f49d-414f-b74f-9f8844d05829 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26926bb3-1f72-42d2-8490-1f1625579ec4 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4.18119309-23b2-433f-8db7-28f51a3d3b75" returned: 0 in 0.714s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:08 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-95522a1a-f49d-414f-b74f-9f8844d05829 tempest-ProjectMemberTests-1669144745 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4.18119309-23b2-433f-8db7-28f51a3d3b75 is being set with open permissions: ugo+rw
Jul 03 13:26:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-95522a1a-f49d-414f-b74f-9f8844d05829 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4.18119309-23b2-433f-8db7-28f51a3d3b75 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:08 devstack sudo[108176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4.18119309-23b2-433f-8db7-28f51a3d3b75
Jul 03 13:26:08 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:09 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-95522a1a-f49d-414f-b74f-9f8844d05829 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4.18119309-23b2-433f-8db7-28f51a3d3b75" returned: 0 in 0.703s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-95522a1a-f49d-414f-b74f-9f8844d05829 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:09 devstack sudo[108179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4.info
Jul 03 13:26:09 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:10 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-95522a1a-f49d-414f-b74f-9f8844d05829 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4.info" returned: 0 in 0.703s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:10 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-95522a1a-f49d-414f-b74f-9f8844d05829 tempest-ProjectMemberTests-1669144745 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4.info is being set with open permissions: ugo+rw
Jul 03 13:26:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-95522a1a-f49d-414f-b74f-9f8844d05829 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:10 devstack sudo[108182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4.info
Jul 03 13:26:10 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:10 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-95522a1a-f49d-414f-b74f-9f8844d05829 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4.info" returned: 0 in 0.700s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-95522a1a-f49d-414f-b74f-9f8844d05829 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.652s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:26:10 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-95522a1a-f49d-414f-b74f-9f8844d05829 tempest-ProjectMemberTests-1669144745 None] Create snapshot completed successfully
Jul 03 13:26:11 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-536db75e-38f7-4077-ada9-590c171ab491 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-18119309-23b2-433f-8db7-28f51a3d3b75-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:26:11 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-536db75e-38f7-4077-ada9-590c171ab491 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-18119309-23b2-433f-8db7-28f51a3d3b75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:26:11 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-536db75e-38f7-4077-ada9-590c171ab491 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-quobyte-26926bb3-1f72-42d2-8490-1f1625579ec4" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:26:11 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-536db75e-38f7-4077-ada9-590c171ab491 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-26926bb3-1f72-42d2-8490-1f1625579ec4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:26:11 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-536db75e-38f7-4077-ada9-590c171ab491 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-quobyte-18119309-23b2-433f-8db7-28f51a3d3b75" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:26:11 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-536db75e-38f7-4077-ada9-590c171ab491 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-18119309-23b2-433f-8db7-28f51a3d3b75" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:26:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-536db75e-38f7-4077-ada9-590c171ab491 tempest-ProjectMemberTests-1669144745 None] Deleting offline snapshot 18119309-23b2-433f-8db7-28f51a3d3b75 of volume 26926bb3-1f72-42d2-8490-1f1625579ec4 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:26:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-536db75e-38f7-4077-ada9-590c171ab491 tempest-ProjectMemberTests-1669144745 None] snapshot_file for this snap is: volume-26926bb3-1f72-42d2-8490-1f1625579ec4.18119309-23b2-433f-8db7-28f51a3d3b75 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:26:11 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2230263-c6a2-4d9e-bc1b-cac33be78479]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:26:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-536db75e-38f7-4077-ada9-590c171ab491 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4.18119309-23b2-433f-8db7-28f51a3d3b75 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:11 devstack sudo[108185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4.18119309-23b2-433f-8db7-28f51a3d3b75
Jul 03 13:26:11 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:12 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-536db75e-38f7-4077-ada9-590c171ab491 tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4.18119309-23b2-433f-8db7-28f51a3d3b75" returned: 0 in 0.785s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:12 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-536db75e-38f7-4077-ada9-590c171ab491 tempest-ProjectMemberTests-1669144745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26926bb3-1f72-42d2-8490-1f1625579ec4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:26:12 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cda889d-777e-4a2e-a01b-57659b60a828]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:26:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-536db75e-38f7-4077-ada9-590c171ab491 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:12 devstack sudo[108190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4
Jul 03 13:26:12 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:13 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-536db75e-38f7-4077-ada9-590c171ab491 tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4" returned: 0 in 0.753s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-536db75e-38f7-4077-ada9-590c171ab491 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4.18119309-23b2-433f-8db7-28f51a3d3b75 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:13 devstack sudo[108195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4.18119309-23b2-433f-8db7-28f51a3d3b75
Jul 03 13:26:13 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:13 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-536db75e-38f7-4077-ada9-590c171ab491 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4.18119309-23b2-433f-8db7-28f51a3d3b75" returned: 0 in 0.802s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-536db75e-38f7-4077-ada9-590c171ab491 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4.18119309-23b2-433f-8db7-28f51a3d3b75 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:14 devstack sudo[108201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4.18119309-23b2-433f-8db7-28f51a3d3b75
Jul 03 13:26:14 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:14 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-536db75e-38f7-4077-ada9-590c171ab491 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4.18119309-23b2-433f-8db7-28f51a3d3b75" returned: 0 in 0.687s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-536db75e-38f7-4077-ada9-590c171ab491 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-18119309-23b2-433f-8db7-28f51a3d3b75" released by "_delete_snapshot" :: held 3.118s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:26:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-536db75e-38f7-4077-ada9-590c171ab491 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-26926bb3-1f72-42d2-8490-1f1625579ec4" released by "delete_snapshot" :: held 3.140s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:26:14 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-536db75e-38f7-4077-ada9-590c171ab491 tempest-ProjectMemberTests-1669144745 None] Created reservations ['040dc99a-5322-44e0-8093-a30f5d86d4a2', '31fc56a5-d2e3-4cfc-9891-ccbd52d31957', 'f9c01bbf-7db0-44f2-ade4-d60520b3c483', '0dcbf0e5-2ca5-4efa-b2ab-905c92674399'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:26:14 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-536db75e-38f7-4077-ada9-590c171ab491 tempest-ProjectMemberTests-1669144745 None] Delete snapshot completed successfully.
Jul 03 13:26:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-536db75e-38f7-4077-ada9-590c171ab491 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-18119309-23b2-433f-8db7-28f51a3d3b75-delete_snapshot" released by "delete_snapshot" :: held 3.272s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:26:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:26:14 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 28 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:26:14 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>, <Thread(tpool_thread_0, started daemon 134850092431040)>, <Thread(tpool_thread_1, started daemon 134850084021952)>, <Thread(tpool_thread_2, started daemon 134850075612864)>, <Thread(tpool_thread_3, started daemon 134850067203776)>, <Thread(tpool_thread_4, started daemon 134850058794688)>, <Thread(tpool_thread_5, started daemon 134850050385600)>, <Thread(tpool_thread_6, started daemon 134850041976512)>, <Thread(tpool_thread_7, started daemon 134850033567424)>, <Thread(tpool_thread_8, started daemon 134850025158336)>, <Thread(tpool_thread_9, started daemon 134850016749248)>, <Thread(tpool_thread_10, started daemon 134850008340160)>, <Thread(tpool_thread_11, started daemon 134849999931072)>, <Thread(tpool_thread_12, started daemon 134849991521984)>, <Thread(tpool_thread_13, started daemon 134849983112896)>, <Thread(tpool_thread_14, started daemon 134849974703808)>, <Thread(tpool_thread_15, started daemon 134849966294720)>, <Thread(tpool_thread_16, started daemon 134849957885632)>, <Thread(tpool_thread_17, started daemon 134849949476544)>, <Thread(tpool_thread_18, started daemon 134849941067456)>, <Thread(tpool_thread_19, started daemon 134849932658368)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:26:15 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d3818443-c6cb-4473-a83a-52e12a71dac3 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-26926bb3-1f72-42d2-8490-1f1625579ec4-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:26:15 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d3818443-c6cb-4473-a83a-52e12a71dac3 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-26926bb3-1f72-42d2-8490-1f1625579ec4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:26:15 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d3818443-c6cb-4473-a83a-52e12a71dac3 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-quobyte-26926bb3-1f72-42d2-8490-1f1625579ec4" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:26:15 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d3818443-c6cb-4473-a83a-52e12a71dac3 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-26926bb3-1f72-42d2-8490-1f1625579ec4" acquired by "delete_volume" :: waited 0.016s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:26:15 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[539761a9-06dc-48d3-b70d-bc547f78504a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:26:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d3818443-c6cb-4473-a83a-52e12a71dac3 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:15 devstack sudo[108204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4
Jul 03 13:26:15 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:16 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d3818443-c6cb-4473-a83a-52e12a71dac3 tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4" returned: 0 in 0.796s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d3818443-c6cb-4473-a83a-52e12a71dac3 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:16 devstack sudo[108209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4
Jul 03 13:26:16 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:17 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d3818443-c6cb-4473-a83a-52e12a71dac3 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-26926bb3-1f72-42d2-8490-1f1625579ec4" returned: 0 in 0.658s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d3818443-c6cb-4473-a83a-52e12a71dac3 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-26926bb3-1f72-42d2-8490-1f1625579ec4" released by "delete_volume" :: held 1.539s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:26:17 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-d3818443-c6cb-4473-a83a-52e12a71dac3 tempest-ProjectMemberTests-1669144745 None] Created reservations ['5c9343b0-e2cf-40d2-b7c3-05df1e17a839', '8b061378-9ac6-435d-840a-f91bbfb5bced', '87235f79-d11c-4a77-bb03-d7c8703c3590', 'e42d4456-8107-44fa-8414-41b741f231ed'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:26:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d3818443-c6cb-4473-a83a-52e12a71dac3 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:26:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d3818443-c6cb-4473-a83a-52e12a71dac3 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:26:17 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d3818443-c6cb-4473-a83a-52e12a71dac3 tempest-ProjectMemberTests-1669144745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:26:17 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d3818443-c6cb-4473-a83a-52e12a71dac3 tempest-ProjectMemberTests-1669144745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:26:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d3818443-c6cb-4473-a83a-52e12a71dac3 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:26:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d3818443-c6cb-4473-a83a-52e12a71dac3 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:17 devstack sudo[108212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:26:17 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:18 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d3818443-c6cb-4473-a83a-52e12a71dac3 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.694s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:18 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-d3818443-c6cb-4473-a83a-52e12a71dac3 tempest-ProjectMemberTests-1669144745 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:26:18 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-d3818443-c6cb-4473-a83a-52e12a71dac3 tempest-ProjectMemberTests-1669144745 None] Deleted volume successfully.
Jul 03 13:26:18 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d3818443-c6cb-4473-a83a-52e12a71dac3 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-26926bb3-1f72-42d2-8490-1f1625579ec4-delete_volume" released by "delete_volume" :: held 2.451s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:26:18 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:26:18 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Flow 'volume_create_manager' (cb797a38-8ff5-4d2a-bd18-7a15e2b17c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:26:18 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad9255b-58c6-40ad-8201-99d1197ff6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:26:18 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad9255b-58c6-40ad-8201-99d1197ff6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1894308950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c3c92d-9e27-4719-a921-64db829fff82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8d4fe10f484b91aa1fc4422b05cde7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:26:18Z,use_quota=True,user_id='2b582c4b94f7429ab6e89182333ff8a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:26:18 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a08c4df-4118-4b5c-bfa9-ca0f2ce4e0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:26:18 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a08c4df-4118-4b5c-bfa9-ca0f2ce4e0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:26:18 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c0161b-ab47-45a4-8656-0f58f0361617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:26:18 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c0161b-ab47-45a4-8656-0f58f0361617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54c3c92d-9e27-4719-a921-64db829fff82', 'volume_name': 'volume-54c3c92d-9e27-4719-a921-64db829fff82', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:26:18 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d51667f2-652d-4ad8-9875-5c80684e3d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:26:18 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d51667f2-652d-4ad8-9875-5c80684e3d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:26:18 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acca2eb2-4aa7-4e87-84ad-16c0a8a831e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:26:18 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Volume 54c3c92d-9e27-4719-a921-64db829fff82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54c3c92d-9e27-4719-a921-64db829fff82', 'volume_size': 1}
Jul 03 13:26:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:26:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:26:18 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1894308950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c3c92d-9e27-4719-a921-64db829fff82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8d4fe10f484b91aa1fc4422b05cde7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:26:18Z,use_quota=True,user_id='2b582c4b94f7429ab6e89182333ff8a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:26:18 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Creating volume 54c3c92d-9e27-4719-a921-64db829fff82 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:26:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:26:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:26:18 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:26:18 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:26:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:26:18 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:26:18 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:26:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:18 devstack sudo[108215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82 1073741824
Jul 03 13:26:18 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:19 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82 1073741824" returned: 0 in 0.819s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:19 devstack sudo[108221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82
Jul 03 13:26:19 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:20 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82" returned: 0 in 0.633s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:20 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:26:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:26:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acca2eb2-4aa7-4e87-84ad-16c0a8a831e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54c3c92d-9e27-4719-a921-64db829fff82', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:26:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81ac087-f2a6-4833-8e75-0c4e3aa6f1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:26:20 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Volume volume-54c3c92d-9e27-4719-a921-64db829fff82 (54c3c92d-9e27-4719-a921-64db829fff82): created successfully
Jul 03 13:26:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81ac087-f2a6-4833-8e75-0c4e3aa6f1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:26:20 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Flow 'volume_create_manager' (cb797a38-8ff5-4d2a-bd18-7a15e2b17c6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:26:20 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=70,cinder:INSERT=21,cinder:UPDATE=89,cinder:DELETE=4 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:26:20 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-0e846081-3028-4fca-be23-13e69223ae6e tempest-ProjectMemberTests-1669144745 None] Created volume successfully.
Jul 03 13:26:20 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:INSERT=26,cinder:UPDATE=88,cinder:SELECT=60,cinder:DELETE=10 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:26:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ec96e166-a9f9-4845-ba82-a4967da8ca77 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:26:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ec96e166-a9f9-4845-ba82-a4967da8ca77 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:26:20 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-ec96e166-a9f9-4845-ba82-a4967da8ca77 tempest-ProjectMemberTests-1669144745 None] Creating offline snapshot b860866b-377d-490f-8cca-1513dca0f5f7 of volume 54c3c92d-9e27-4719-a921-64db829fff82 {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:26:20 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b7ce76-09a3-48a5-b3b4-843772584317]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:26:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ec96e166-a9f9-4845-ba82-a4967da8ca77 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:20 devstack sudo[108224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82
Jul 03 13:26:20 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:21 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ec96e166-a9f9-4845-ba82-a4967da8ca77 tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82" returned: 0 in 0.772s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ec96e166-a9f9-4845-ba82-a4967da8ca77 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82.b860866b-377d-490f-8cca-1513dca0f5f7 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:21 devstack sudo[108229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82.b860866b-377d-490f-8cca-1513dca0f5f7 1G
Jul 03 13:26:21 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:22 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ec96e166-a9f9-4845-ba82-a4967da8ca77 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82.b860866b-377d-490f-8cca-1513dca0f5f7 1G" returned: 0 in 0.826s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ec96e166-a9f9-4845-ba82-a4967da8ca77 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54c3c92d-9e27-4719-a921-64db829fff82 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82.b860866b-377d-490f-8cca-1513dca0f5f7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:22 devstack sudo[108234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54c3c92d-9e27-4719-a921-64db829fff82 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82.b860866b-377d-490f-8cca-1513dca0f5f7
Jul 03 13:26:22 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:22 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ec96e166-a9f9-4845-ba82-a4967da8ca77 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54c3c92d-9e27-4719-a921-64db829fff82 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82.b860866b-377d-490f-8cca-1513dca0f5f7" returned: 0 in 0.656s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:22 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-ec96e166-a9f9-4845-ba82-a4967da8ca77 tempest-ProjectMemberTests-1669144745 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82.b860866b-377d-490f-8cca-1513dca0f5f7 is being set with open permissions: ugo+rw
Jul 03 13:26:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ec96e166-a9f9-4845-ba82-a4967da8ca77 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82.b860866b-377d-490f-8cca-1513dca0f5f7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:22 devstack sudo[108239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82.b860866b-377d-490f-8cca-1513dca0f5f7
Jul 03 13:26:22 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:23 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ec96e166-a9f9-4845-ba82-a4967da8ca77 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82.b860866b-377d-490f-8cca-1513dca0f5f7" returned: 0 in 0.614s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ec96e166-a9f9-4845-ba82-a4967da8ca77 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:23 devstack sudo[108243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82.info
Jul 03 13:26:23 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:24 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ec96e166-a9f9-4845-ba82-a4967da8ca77 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82.info" returned: 0 in 0.654s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:24 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-ec96e166-a9f9-4845-ba82-a4967da8ca77 tempest-ProjectMemberTests-1669144745 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82.info is being set with open permissions: ugo+rw
Jul 03 13:26:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ec96e166-a9f9-4845-ba82-a4967da8ca77 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:24 devstack sudo[108252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82.info
Jul 03 13:26:24 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:24 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ec96e166-a9f9-4845-ba82-a4967da8ca77 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82.info" returned: 0 in 0.668s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ec96e166-a9f9-4845-ba82-a4967da8ca77 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.269s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:26:24 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-ec96e166-a9f9-4845-ba82-a4967da8ca77 tempest-ProjectMemberTests-1669144745 None] Create snapshot completed successfully
Jul 03 13:26:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2feba0dc-0b6e-4d3c-81a1-a50c521e1543 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-b860866b-377d-490f-8cca-1513dca0f5f7-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:26:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2feba0dc-0b6e-4d3c-81a1-a50c521e1543 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-b860866b-377d-490f-8cca-1513dca0f5f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:26:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2feba0dc-0b6e-4d3c-81a1-a50c521e1543 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-quobyte-54c3c92d-9e27-4719-a921-64db829fff82" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:26:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2feba0dc-0b6e-4d3c-81a1-a50c521e1543 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-54c3c92d-9e27-4719-a921-64db829fff82" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:26:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2feba0dc-0b6e-4d3c-81a1-a50c521e1543 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-quobyte-b860866b-377d-490f-8cca-1513dca0f5f7" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:26:25 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2feba0dc-0b6e-4d3c-81a1-a50c521e1543 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-b860866b-377d-490f-8cca-1513dca0f5f7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:26:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-2feba0dc-0b6e-4d3c-81a1-a50c521e1543 tempest-ProjectMemberTests-1669144745 None] Deleting offline snapshot b860866b-377d-490f-8cca-1513dca0f5f7 of volume 54c3c92d-9e27-4719-a921-64db829fff82 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:26:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-2feba0dc-0b6e-4d3c-81a1-a50c521e1543 tempest-ProjectMemberTests-1669144745 None] snapshot_file for this snap is: volume-54c3c92d-9e27-4719-a921-64db829fff82.b860866b-377d-490f-8cca-1513dca0f5f7 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:26:25 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2b9f41-a057-421d-8fa4-d9b321edeeec]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:26:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2feba0dc-0b6e-4d3c-81a1-a50c521e1543 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82.b860866b-377d-490f-8cca-1513dca0f5f7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:26 devstack sudo[108255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82.b860866b-377d-490f-8cca-1513dca0f5f7
Jul 03 13:26:26 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:26 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2feba0dc-0b6e-4d3c-81a1-a50c521e1543 tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82.b860866b-377d-490f-8cca-1513dca0f5f7" returned: 0 in 0.832s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:26 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-2feba0dc-0b6e-4d3c-81a1-a50c521e1543 tempest-ProjectMemberTests-1669144745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54c3c92d-9e27-4719-a921-64db829fff82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:26:26 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[91412689-2c09-4504-b931-915f3ac4e8ac]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:26:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2feba0dc-0b6e-4d3c-81a1-a50c521e1543 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:26 devstack sudo[108296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82
Jul 03 13:26:26 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:27 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2feba0dc-0b6e-4d3c-81a1-a50c521e1543 tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82" returned: 0 in 0.785s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2feba0dc-0b6e-4d3c-81a1-a50c521e1543 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82.b860866b-377d-490f-8cca-1513dca0f5f7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:27 devstack sudo[108301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82.b860866b-377d-490f-8cca-1513dca0f5f7
Jul 03 13:26:27 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:28 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2feba0dc-0b6e-4d3c-81a1-a50c521e1543 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82.b860866b-377d-490f-8cca-1513dca0f5f7" returned: 0 in 0.762s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2feba0dc-0b6e-4d3c-81a1-a50c521e1543 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82.b860866b-377d-490f-8cca-1513dca0f5f7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:28 devstack sudo[108306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82.b860866b-377d-490f-8cca-1513dca0f5f7
Jul 03 13:26:28 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:29 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2feba0dc-0b6e-4d3c-81a1-a50c521e1543 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82.b860866b-377d-490f-8cca-1513dca0f5f7" returned: 0 in 0.672s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:29 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2feba0dc-0b6e-4d3c-81a1-a50c521e1543 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-b860866b-377d-490f-8cca-1513dca0f5f7" released by "_delete_snapshot" :: held 3.143s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:26:29 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2feba0dc-0b6e-4d3c-81a1-a50c521e1543 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-54c3c92d-9e27-4719-a921-64db829fff82" released by "delete_snapshot" :: held 3.168s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:26:29 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-2feba0dc-0b6e-4d3c-81a1-a50c521e1543 tempest-ProjectMemberTests-1669144745 None] Created reservations ['4f9576a8-cc97-4820-b0ac-26b050c15971', 'c7b204b0-eafc-457e-8489-2203c2b91ddf', 'b5257072-4c76-4452-a01c-9832478a50b4', '89c480f1-cc8b-47ec-942b-7bcb726f94d1'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:26:29 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-2feba0dc-0b6e-4d3c-81a1-a50c521e1543 tempest-ProjectMemberTests-1669144745 None] Delete snapshot completed successfully.
Jul 03 13:26:29 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-2feba0dc-0b6e-4d3c-81a1-a50c521e1543 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-b860866b-377d-490f-8cca-1513dca0f5f7-delete_snapshot" released by "delete_snapshot" :: held 3.306s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:26:30 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-dd277e74-a139-421f-83a5-c53e1e70cfd4 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-54c3c92d-9e27-4719-a921-64db829fff82-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:26:30 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-dd277e74-a139-421f-83a5-c53e1e70cfd4 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-54c3c92d-9e27-4719-a921-64db829fff82-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:26:30 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-dd277e74-a139-421f-83a5-c53e1e70cfd4 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-quobyte-54c3c92d-9e27-4719-a921-64db829fff82" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:26:30 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-dd277e74-a139-421f-83a5-c53e1e70cfd4 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-54c3c92d-9e27-4719-a921-64db829fff82" acquired by "delete_volume" :: waited 0.018s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:26:30 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf0809b-c682-491f-9dc6-e3734bf46abc]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:26:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dd277e74-a139-421f-83a5-c53e1e70cfd4 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:30 devstack sudo[108309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82
Jul 03 13:26:30 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:30 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dd277e74-a139-421f-83a5-c53e1e70cfd4 tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82" returned: 0 in 0.765s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dd277e74-a139-421f-83a5-c53e1e70cfd4 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:31 devstack sudo[108314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82
Jul 03 13:26:31 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:31 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dd277e74-a139-421f-83a5-c53e1e70cfd4 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-54c3c92d-9e27-4719-a921-64db829fff82" returned: 0 in 0.633s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:31 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-dd277e74-a139-421f-83a5-c53e1e70cfd4 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-54c3c92d-9e27-4719-a921-64db829fff82" released by "delete_volume" :: held 1.457s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:26:31 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-dd277e74-a139-421f-83a5-c53e1e70cfd4 tempest-ProjectMemberTests-1669144745 None] Created reservations ['8d568382-9afd-45c0-8b7d-f23faba1c077', '5a21e072-d43f-45e3-a738-0ab35de481b2', '914147ab-9dfc-49e6-a711-e62d3c911409', 'e155ab3b-c3ea-4d4b-9481-25c4c0aa880b'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:26:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-dd277e74-a139-421f-83a5-c53e1e70cfd4 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:26:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-dd277e74-a139-421f-83a5-c53e1e70cfd4 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:26:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-dd277e74-a139-421f-83a5-c53e1e70cfd4 tempest-ProjectMemberTests-1669144745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:26:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-dd277e74-a139-421f-83a5-c53e1e70cfd4 tempest-ProjectMemberTests-1669144745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:26:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-dd277e74-a139-421f-83a5-c53e1e70cfd4 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:26:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dd277e74-a139-421f-83a5-c53e1e70cfd4 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:31 devstack sudo[108317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:26:31 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:32 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-dd277e74-a139-421f-83a5-c53e1e70cfd4 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.612s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:32 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-dd277e74-a139-421f-83a5-c53e1e70cfd4 tempest-ProjectMemberTests-1669144745 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:26:32 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-dd277e74-a139-421f-83a5-c53e1e70cfd4 tempest-ProjectMemberTests-1669144745 None] Deleted volume successfully.
Jul 03 13:26:32 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-dd277e74-a139-421f-83a5-c53e1e70cfd4 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-54c3c92d-9e27-4719-a921-64db829fff82-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:26:32 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:26:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Flow 'volume_create_manager' (c6a2d9f6-4b8b-44f3-aa92-0fea9c62057b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:26:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc7d85f7-4a73-410e-8541-9215f1401c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:26:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc7d85f7-4a73-410e-8541-9215f1401c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-556309515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e27b4b80-0bce-4332-b02c-5d993fae5f09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8d4fe10f484b91aa1fc4422b05cde7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:26:33Z,use_quota=True,user_id='2b582c4b94f7429ab6e89182333ff8a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:26:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a023340b-0e4c-47a6-9409-a9aaf01ef830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:26:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a023340b-0e4c-47a6-9409-a9aaf01ef830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:26:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (479f9c40-9de3-4ec8-8727-b9c219783631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:26:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (479f9c40-9de3-4ec8-8727-b9c219783631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e27b4b80-0bce-4332-b02c-5d993fae5f09', 'volume_name': 'volume-e27b4b80-0bce-4332-b02c-5d993fae5f09', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:26:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7695c5f-b41c-428c-9536-97960f51a11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:26:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7695c5f-b41c-428c-9536-97960f51a11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:26:32 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c54800-898d-453a-ad62-511db54efb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:26:32 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Volume e27b4b80-0bce-4332-b02c-5d993fae5f09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e27b4b80-0bce-4332-b02c-5d993fae5f09', 'volume_size': 1}
Jul 03 13:26:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:26:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:26:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-556309515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e27b4b80-0bce-4332-b02c-5d993fae5f09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8d4fe10f484b91aa1fc4422b05cde7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:26:33Z,use_quota=True,user_id='2b582c4b94f7429ab6e89182333ff8a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:26:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Creating volume e27b4b80-0bce-4332-b02c-5d993fae5f09 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:26:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:26:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:26:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:26:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:26:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:26:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:26:32 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:26:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:32 devstack sudo[108320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09 1073741824
Jul 03 13:26:32 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:33 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09 1073741824" returned: 0 in 0.787s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:33 devstack sudo[108327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09
Jul 03 13:26:33 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:34 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09" returned: 0 in 0.622s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:26:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:26:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c54800-898d-453a-ad62-511db54efb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e27b4b80-0bce-4332-b02c-5d993fae5f09', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:26:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9207ebe4-6a15-4d7c-8eeb-2de9eab89c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:26:34 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Volume volume-e27b4b80-0bce-4332-b02c-5d993fae5f09 (e27b4b80-0bce-4332-b02c-5d993fae5f09): created successfully
Jul 03 13:26:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9207ebe4-6a15-4d7c-8eeb-2de9eab89c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:26:34 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Flow 'volume_create_manager' (c6a2d9f6-4b8b-44f3-aa92-0fea9c62057b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:26:34 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-3b9a204c-eab7-441d-911b-94aeac8c5fa1 tempest-ProjectMemberTests-1669144745 None] Created volume successfully.
Jul 03 13:26:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-73c4d251-8f53-4f45-a5a1-8ba4352464c7 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:26:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-73c4d251-8f53-4f45-a5a1-8ba4352464c7 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:26:34 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-73c4d251-8f53-4f45-a5a1-8ba4352464c7 tempest-ProjectMemberTests-1669144745 None] Creating offline snapshot fc360596-8a8f-4c68-aa8f-269c1b21217e of volume e27b4b80-0bce-4332-b02c-5d993fae5f09 {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:26:34 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[6faef372-d2ba-45b3-9aa6-50d997667697]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:26:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-73c4d251-8f53-4f45-a5a1-8ba4352464c7 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:35 devstack sudo[108330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09
Jul 03 13:26:35 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:35 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-73c4d251-8f53-4f45-a5a1-8ba4352464c7 tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09" returned: 0 in 0.741s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-73c4d251-8f53-4f45-a5a1-8ba4352464c7 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09.fc360596-8a8f-4c68-aa8f-269c1b21217e 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:35 devstack sudo[108336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09.fc360596-8a8f-4c68-aa8f-269c1b21217e 1G
Jul 03 13:26:35 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:36 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-73c4d251-8f53-4f45-a5a1-8ba4352464c7 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09.fc360596-8a8f-4c68-aa8f-269c1b21217e 1G" returned: 0 in 0.778s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-73c4d251-8f53-4f45-a5a1-8ba4352464c7 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e27b4b80-0bce-4332-b02c-5d993fae5f09 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09.fc360596-8a8f-4c68-aa8f-269c1b21217e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:36 devstack sudo[108341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e27b4b80-0bce-4332-b02c-5d993fae5f09 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09.fc360596-8a8f-4c68-aa8f-269c1b21217e
Jul 03 13:26:36 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:37 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-73c4d251-8f53-4f45-a5a1-8ba4352464c7 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e27b4b80-0bce-4332-b02c-5d993fae5f09 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09.fc360596-8a8f-4c68-aa8f-269c1b21217e" returned: 0 in 0.678s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:37 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-73c4d251-8f53-4f45-a5a1-8ba4352464c7 tempest-ProjectMemberTests-1669144745 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09.fc360596-8a8f-4c68-aa8f-269c1b21217e is being set with open permissions: ugo+rw
Jul 03 13:26:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-73c4d251-8f53-4f45-a5a1-8ba4352464c7 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09.fc360596-8a8f-4c68-aa8f-269c1b21217e {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:37 devstack sudo[108347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09.fc360596-8a8f-4c68-aa8f-269c1b21217e
Jul 03 13:26:37 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:37 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-73c4d251-8f53-4f45-a5a1-8ba4352464c7 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09.fc360596-8a8f-4c68-aa8f-269c1b21217e" returned: 0 in 0.608s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-73c4d251-8f53-4f45-a5a1-8ba4352464c7 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:37 devstack sudo[108350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09.info
Jul 03 13:26:37 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:38 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-73c4d251-8f53-4f45-a5a1-8ba4352464c7 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09.info" returned: 0 in 0.641s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:38 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-73c4d251-8f53-4f45-a5a1-8ba4352464c7 tempest-ProjectMemberTests-1669144745 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09.info is being set with open permissions: ugo+rw
Jul 03 13:26:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-73c4d251-8f53-4f45-a5a1-8ba4352464c7 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:26:38 devstack sudo[108353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09.info
Jul 03 13:26:38 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:26:39 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root
Jul 03 13:26:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-73c4d251-8f53-4f45-a5a1-8ba4352464c7 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-e27b4b80-0bce-4332-b02c-5d993fae5f09.info" returned: 0 in 0.638s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:26:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-73c4d251-8f53-4f45-a5a1-8ba4352464c7 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.159s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:26:39 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-73c4d251-8f53-4f45-a5a1-8ba4352464c7 tempest-ProjectMemberTests-1669144745 None] Create snapshot completed successfully
Jul 03 13:26:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c6eca254-0127-4daa-8cb4-f60c2edaed7b tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-fc360596-8a8f-4c68-aa8f-269c1b21217e-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:26:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c6eca254-0127-4daa-8cb4-f60c2edaed7b tempest-ProjectMemberTests-1669144745 None] Lock "cinder-fc360596-8a8f-4c68-aa8f-269c1b21217e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:26:40 devstack cinder-volume[86837]: INFO cinder.message.api [None req-c6eca254-0127-4daa-8cb4-f60c2edaed7b tempest-ProjectMemberTests-1669144745 None] Creating message record for request_id = req-c6eca254-0127-4daa-8cb4-f60c2edaed7b
Jul 03 13:26:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-c6eca254-0127-4daa-8cb4-f60c2edaed7b tempest-ProjectMemberTests-1669144745 None] Lock "cinder-fc360596-8a8f-4c68-aa8f-269c1b21217e-delete_snapshot" released by "delete_snapshot" :: held 0.031s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server [None req-c6eca254-0127-4daa-8cb4-f60c2edaed7b tempest-ProjectMemberTests-1669144745 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'?
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server     skip_clean = func(self, context, snapshot, *args, **kwargs)
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server     return f(*a, **k)
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server     raise self.value
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server     self.driver.unmanage_snapshot(snapshot)
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'?
Jul 03 13:26:40 devstack cinder-volume[86837]: ERROR oslo_messaging.rpc.server 
Jul 03 13:26:49 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=18,cinder:UPDATE=16,cinder:DELETE=3,cinder:INSERT=5 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:26:50 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:UPDATE=24,cinder:SELECT=15,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:27:00 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:27:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:27:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:27:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:27:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:27:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:27:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:27:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:27:15 devstack sudo[108365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:27:15 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:27:15 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root
Jul 03 13:27:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.631s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:27:15 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:27:15 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:27:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 28 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:27:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>, <Thread(tpool_thread_0, started daemon 134850092431040)>, <Thread(tpool_thread_1, started daemon 134850084021952)>, <Thread(tpool_thread_2, started daemon 134850075612864)>, <Thread(tpool_thread_3, started daemon 134850067203776)>, <Thread(tpool_thread_4, started daemon 134850058794688)>, <Thread(tpool_thread_5, started daemon 134850050385600)>, <Thread(tpool_thread_6, started daemon 134850041976512)>, <Thread(tpool_thread_7, started daemon 134850033567424)>, <Thread(tpool_thread_8, started daemon 134850025158336)>, <Thread(tpool_thread_9, started daemon 134850016749248)>, <Thread(tpool_thread_10, started daemon 134850008340160)>, <Thread(tpool_thread_11, started daemon 134849999931072)>, <Thread(tpool_thread_12, started daemon 134849991521984)>, <Thread(tpool_thread_13, started daemon 134849983112896)>, <Thread(tpool_thread_14, started daemon 134849974703808)>, <Thread(tpool_thread_15, started daemon 134849966294720)>, <Thread(tpool_thread_16, started daemon 134849957885632)>, <Thread(tpool_thread_17, started daemon 134849949476544)>, <Thread(tpool_thread_18, started daemon 134849941067456)>, <Thread(tpool_thread_19, started daemon 134849932658368)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:28:02 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:28:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Flow 'volume_create_manager' (da35d902-e82b-4cf0-a9d1-576a903f15f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:28:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14be3d3a-676f-49d2-b90f-6a43817fb8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:28:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14be3d3a-676f-49d2-b90f-6a43817fb8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1773488439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5a1d6c-bf5d-4022-9244-20dbbdde976d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9b9895e6094ba491a40e642c6a03b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:28:02Z,use_quota=True,user_id='8fca7bfb7d5b44a6a8b3f9e7153bf18a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:28:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (660fd262-41ec-4922-b3b2-4abee7294cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:28:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (660fd262-41ec-4922-b3b2-4abee7294cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:28:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (673da83e-8770-452a-bc31-5c8aa82e4243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:28:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (673da83e-8770-452a-bc31-5c8aa82e4243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b5a1d6c-bf5d-4022-9244-20dbbdde976d', 'volume_name': 'volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:28:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e7d0aec-66b3-4563-a6a8-b86b2508890b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:28:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e7d0aec-66b3-4563-a6a8-b86b2508890b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:28:02 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262f27bd-398c-4f2c-8cd9-3291c844f2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:28:02 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Volume 2b5a1d6c-bf5d-4022-9244-20dbbdde976d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d', 'volume_size': 1}
Jul 03 13:28:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:28:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:28:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1773488439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5a1d6c-bf5d-4022-9244-20dbbdde976d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9b9895e6094ba491a40e642c6a03b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:28:02Z,use_quota=True,user_id='8fca7bfb7d5b44a6a8b3f9e7153bf18a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:28:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Creating volume 2b5a1d6c-bf5d-4022-9244-20dbbdde976d {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:28:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:28:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:28:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:28:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:28:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:28:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:28:02 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:28:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:02 devstack sudo[108420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d 1073741824
Jul 03 13:28:02 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:03 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d 1073741824" returned: 0 in 0.845s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:03 devstack sudo[108425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d
Jul 03 13:28:03 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:03 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d" returned: 0 in 0.639s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:03 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:28:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:28:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262f27bd-398c-4f2c-8cd9-3291c844f2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:28:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1209c3-2bde-4521-a643-c684f8ba87d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:28:04 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Volume volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d (2b5a1d6c-bf5d-4022-9244-20dbbdde976d): created successfully
Jul 03 13:28:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1209c3-2bde-4521-a643-c684f8ba87d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:28:04 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Flow 'volume_create_manager' (da35d902-e82b-4cf0-a9d1-576a903f15f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:28:04 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-f228ebe9-63a9-4c34-b2ea-e04d08303b05 tempest-ProjectReaderTests-1717421477 None] Created volume successfully.
Jul 03 13:28:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a638b789-cc59-4909-9a52-ddab1eb3176b tempest-ProjectReaderTests-1717421477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:28:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a638b789-cc59-4909-9a52-ddab1eb3176b tempest-ProjectReaderTests-1717421477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:28:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-a638b789-cc59-4909-9a52-ddab1eb3176b tempest-ProjectReaderTests-1717421477 None] Creating offline snapshot 6a0b7cde-1a23-4a6f-8f25-d85f4982e125 of volume 2b5a1d6c-bf5d-4022-9244-20dbbdde976d {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:28:04 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a86371-8ebc-45f2-ae94-0955b28b4f4e]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:28:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a638b789-cc59-4909-9a52-ddab1eb3176b tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:04 devstack sudo[108429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d
Jul 03 13:28:04 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:05 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a638b789-cc59-4909-9a52-ddab1eb3176b tempest-ProjectReaderTests-1717421477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d" returned: 0 in 0.738s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a638b789-cc59-4909-9a52-ddab1eb3176b tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d.6a0b7cde-1a23-4a6f-8f25-d85f4982e125 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:05 devstack sudo[108434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d.6a0b7cde-1a23-4a6f-8f25-d85f4982e125 1G
Jul 03 13:28:05 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:06 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a638b789-cc59-4909-9a52-ddab1eb3176b tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d.6a0b7cde-1a23-4a6f-8f25-d85f4982e125 1G" returned: 0 in 0.746s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a638b789-cc59-4909-9a52-ddab1eb3176b tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d.6a0b7cde-1a23-4a6f-8f25-d85f4982e125 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:06 devstack sudo[108439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d.6a0b7cde-1a23-4a6f-8f25-d85f4982e125
Jul 03 13:28:06 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:06 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a638b789-cc59-4909-9a52-ddab1eb3176b tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d.6a0b7cde-1a23-4a6f-8f25-d85f4982e125" returned: 0 in 0.645s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:06 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-a638b789-cc59-4909-9a52-ddab1eb3176b tempest-ProjectReaderTests-1717421477 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d.6a0b7cde-1a23-4a6f-8f25-d85f4982e125 is being set with open permissions: ugo+rw
Jul 03 13:28:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a638b789-cc59-4909-9a52-ddab1eb3176b tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d.6a0b7cde-1a23-4a6f-8f25-d85f4982e125 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:06 devstack sudo[108444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d.6a0b7cde-1a23-4a6f-8f25-d85f4982e125
Jul 03 13:28:06 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:07 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a638b789-cc59-4909-9a52-ddab1eb3176b tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d.6a0b7cde-1a23-4a6f-8f25-d85f4982e125" returned: 0 in 0.629s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a638b789-cc59-4909-9a52-ddab1eb3176b tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:07 devstack sudo[108447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d.info
Jul 03 13:28:07 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:08 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a638b789-cc59-4909-9a52-ddab1eb3176b tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d.info" returned: 0 in 0.622s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:08 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-a638b789-cc59-4909-9a52-ddab1eb3176b tempest-ProjectReaderTests-1717421477 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d.info is being set with open permissions: ugo+rw
Jul 03 13:28:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a638b789-cc59-4909-9a52-ddab1eb3176b tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:08 devstack sudo[108450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d.info
Jul 03 13:28:08 devstack sudo[108450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:08 devstack sudo[108450]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a638b789-cc59-4909-9a52-ddab1eb3176b tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d.info" returned: 0 in 0.623s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a638b789-cc59-4909-9a52-ddab1eb3176b tempest-ProjectReaderTests-1717421477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.075s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:28:08 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-a638b789-cc59-4909-9a52-ddab1eb3176b tempest-ProjectReaderTests-1717421477 None] Create snapshot completed successfully
Jul 03 13:28:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b855674f-c5ed-4b1a-84d9-8fca1052c24e tempest-ProjectReaderTests-1717421477 None] Acquiring lock "cinder-6a0b7cde-1a23-4a6f-8f25-d85f4982e125-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:28:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b855674f-c5ed-4b1a-84d9-8fca1052c24e tempest-ProjectReaderTests-1717421477 None] Lock "cinder-6a0b7cde-1a23-4a6f-8f25-d85f4982e125-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:28:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b855674f-c5ed-4b1a-84d9-8fca1052c24e tempest-ProjectReaderTests-1717421477 None] Acquiring lock "cinder-quobyte-2b5a1d6c-bf5d-4022-9244-20dbbdde976d" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:28:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b855674f-c5ed-4b1a-84d9-8fca1052c24e tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-2b5a1d6c-bf5d-4022-9244-20dbbdde976d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:28:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b855674f-c5ed-4b1a-84d9-8fca1052c24e tempest-ProjectReaderTests-1717421477 None] Acquiring lock "cinder-quobyte-6a0b7cde-1a23-4a6f-8f25-d85f4982e125" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:28:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b855674f-c5ed-4b1a-84d9-8fca1052c24e tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-6a0b7cde-1a23-4a6f-8f25-d85f4982e125" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:28:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-b855674f-c5ed-4b1a-84d9-8fca1052c24e tempest-ProjectReaderTests-1717421477 None] Deleting offline snapshot 6a0b7cde-1a23-4a6f-8f25-d85f4982e125 of volume 2b5a1d6c-bf5d-4022-9244-20dbbdde976d {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:28:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-b855674f-c5ed-4b1a-84d9-8fca1052c24e tempest-ProjectReaderTests-1717421477 None] snapshot_file for this snap is: volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d.6a0b7cde-1a23-4a6f-8f25-d85f4982e125 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:28:09 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[96795b42-2eb5-4313-bb06-d273935f3013]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:28:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b855674f-c5ed-4b1a-84d9-8fca1052c24e tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d.6a0b7cde-1a23-4a6f-8f25-d85f4982e125 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:09 devstack sudo[108453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d.6a0b7cde-1a23-4a6f-8f25-d85f4982e125
Jul 03 13:28:09 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:10 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b855674f-c5ed-4b1a-84d9-8fca1052c24e tempest-ProjectReaderTests-1717421477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d.6a0b7cde-1a23-4a6f-8f25-d85f4982e125" returned: 0 in 0.758s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:10 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-b855674f-c5ed-4b1a-84d9-8fca1052c24e tempest-ProjectReaderTests-1717421477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:28:10 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[606a04c3-93e9-4a7f-a9b5-7377dae80e5c]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:28:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b855674f-c5ed-4b1a-84d9-8fca1052c24e tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:10 devstack sudo[108458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d
Jul 03 13:28:10 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:11 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b855674f-c5ed-4b1a-84d9-8fca1052c24e tempest-ProjectReaderTests-1717421477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d" returned: 0 in 0.777s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b855674f-c5ed-4b1a-84d9-8fca1052c24e tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d.6a0b7cde-1a23-4a6f-8f25-d85f4982e125 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:11 devstack sudo[108464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d.6a0b7cde-1a23-4a6f-8f25-d85f4982e125
Jul 03 13:28:11 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:12 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b855674f-c5ed-4b1a-84d9-8fca1052c24e tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d.6a0b7cde-1a23-4a6f-8f25-d85f4982e125" returned: 0 in 0.729s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b855674f-c5ed-4b1a-84d9-8fca1052c24e tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d.6a0b7cde-1a23-4a6f-8f25-d85f4982e125 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:12 devstack sudo[108469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d.6a0b7cde-1a23-4a6f-8f25-d85f4982e125
Jul 03 13:28:12 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:12 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b855674f-c5ed-4b1a-84d9-8fca1052c24e tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d.6a0b7cde-1a23-4a6f-8f25-d85f4982e125" returned: 0 in 0.626s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b855674f-c5ed-4b1a-84d9-8fca1052c24e tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-6a0b7cde-1a23-4a6f-8f25-d85f4982e125" released by "_delete_snapshot" :: held 2.977s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:28:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b855674f-c5ed-4b1a-84d9-8fca1052c24e tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-2b5a1d6c-bf5d-4022-9244-20dbbdde976d" released by "delete_snapshot" :: held 2.999s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:28:12 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-b855674f-c5ed-4b1a-84d9-8fca1052c24e tempest-ProjectReaderTests-1717421477 None] Created reservations ['a9099ebe-0f3b-4394-8af3-70e785aca37d', '01f7e823-97f5-4370-a7cb-bed3099c770d', 'db6eb3a5-c7a0-4fe5-bea1-8a5fa3446432', '448beeef-834c-48ef-b6a7-faed2400cc23'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:28:12 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-b855674f-c5ed-4b1a-84d9-8fca1052c24e tempest-ProjectReaderTests-1717421477 None] Delete snapshot completed successfully.
Jul 03 13:28:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-b855674f-c5ed-4b1a-84d9-8fca1052c24e tempest-ProjectReaderTests-1717421477 None] Lock "cinder-6a0b7cde-1a23-4a6f-8f25-d85f4982e125-delete_snapshot" released by "delete_snapshot" :: held 3.140s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:28:12 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ccee6f2f-37d2-4681-bb9e-3554f92287ce tempest-ProjectReaderTests-1717421477 None] Acquiring lock "cinder-2b5a1d6c-bf5d-4022-9244-20dbbdde976d-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:28:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ccee6f2f-37d2-4681-bb9e-3554f92287ce tempest-ProjectReaderTests-1717421477 None] Lock "cinder-2b5a1d6c-bf5d-4022-9244-20dbbdde976d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:28:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ccee6f2f-37d2-4681-bb9e-3554f92287ce tempest-ProjectReaderTests-1717421477 None] Acquiring lock "cinder-quobyte-2b5a1d6c-bf5d-4022-9244-20dbbdde976d" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:28:13 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ccee6f2f-37d2-4681-bb9e-3554f92287ce tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-2b5a1d6c-bf5d-4022-9244-20dbbdde976d" acquired by "delete_volume" :: waited 0.021s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:28:13 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[240e8712-7035-431a-9e34-73a686971f46]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:28:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ccee6f2f-37d2-4681-bb9e-3554f92287ce tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:13 devstack sudo[108472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d
Jul 03 13:28:13 devstack sudo[108472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:13 devstack sudo[108472]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ccee6f2f-37d2-4681-bb9e-3554f92287ce tempest-ProjectReaderTests-1717421477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d" returned: 0 in 0.720s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ccee6f2f-37d2-4681-bb9e-3554f92287ce tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:13 devstack sudo[108478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d
Jul 03 13:28:13 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:14 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ccee6f2f-37d2-4681-bb9e-3554f92287ce tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-2b5a1d6c-bf5d-4022-9244-20dbbdde976d" returned: 0 in 0.622s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:14 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ccee6f2f-37d2-4681-bb9e-3554f92287ce tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-2b5a1d6c-bf5d-4022-9244-20dbbdde976d" released by "delete_volume" :: held 1.401s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:28:14 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-ccee6f2f-37d2-4681-bb9e-3554f92287ce tempest-ProjectReaderTests-1717421477 None] Created reservations ['88b000cb-532b-4696-a008-373ecd60ea71', '4f4b8227-d228-4c03-8cf2-0acb4de273bc', '53495a6d-4fba-4862-9fda-be31ac2c0432', '62d8c02c-4d0c-4da7-910a-0b74118b22b2'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:28:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ccee6f2f-37d2-4681-bb9e-3554f92287ce tempest-ProjectReaderTests-1717421477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:28:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ccee6f2f-37d2-4681-bb9e-3554f92287ce tempest-ProjectReaderTests-1717421477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:28:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ccee6f2f-37d2-4681-bb9e-3554f92287ce tempest-ProjectReaderTests-1717421477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:28:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-ccee6f2f-37d2-4681-bb9e-3554f92287ce tempest-ProjectReaderTests-1717421477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:28:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ccee6f2f-37d2-4681-bb9e-3554f92287ce tempest-ProjectReaderTests-1717421477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:28:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ccee6f2f-37d2-4681-bb9e-3554f92287ce tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:14 devstack sudo[108481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:28:14 devstack sudo[108481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:28:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:28:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:28:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:28:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:28:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:28:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:15 devstack sudo[108483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:28:15 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:15 devstack sudo[108481]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ccee6f2f-37d2-4681-bb9e-3554f92287ce tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.635s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-ccee6f2f-37d2-4681-bb9e-3554f92287ce tempest-ProjectReaderTests-1717421477 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:28:15 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-ccee6f2f-37d2-4681-bb9e-3554f92287ce tempest-ProjectReaderTests-1717421477 None] Deleted volume successfully.
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-ccee6f2f-37d2-4681-bb9e-3554f92287ce tempest-ProjectReaderTests-1717421477 None] Lock "cinder-2b5a1d6c-bf5d-4022-9244-20dbbdde976d-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:28:15 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Flow 'volume_create_manager' (86beb1b4-1b0e-48af-b49e-d74033fc0f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85d38e25-a35e-4c9d-a633-0626827e7c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.733s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85d38e25-a35e-4c9d-a633-0626827e7c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2113191201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=997f48c4-73c1-402c-be72-d97a8fe0eba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9b9895e6094ba491a40e642c6a03b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:28:16Z,use_quota=True,user_id='8fca7bfb7d5b44a6a8b3f9e7153bf18a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d655c455-eb19-4742-95be-00f8a9526d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d655c455-eb19-4742-95be-00f8a9526d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ade18c38-3397-46bb-9a5b-8a9c4f95dbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ade18c38-3397-46bb-9a5b-8a9c4f95dbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '997f48c4-73c1-402c-be72-d97a8fe0eba2', 'volume_name': 'volume-997f48c4-73c1-402c-be72-d97a8fe0eba2', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082a4d07-0810-4c4b-b67a-0d91a4c5a8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082a4d07-0810-4c4b-b67a-0d91a4c5a8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fadb8f14-de28-4c95-93c9-28a7215383c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:28:15 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Volume 997f48c4-73c1-402c-be72-d97a8fe0eba2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-997f48c4-73c1-402c-be72-d97a8fe0eba2', 'volume_size': 1}
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2113191201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=997f48c4-73c1-402c-be72-d97a8fe0eba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9b9895e6094ba491a40e642c6a03b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:28:16Z,use_quota=True,user_id='8fca7bfb7d5b44a6a8b3f9e7153bf18a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Creating volume 997f48c4-73c1-402c-be72-d97a8fe0eba2 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:28:15 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 28 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:28:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>, <Thread(tpool_thread_0, started daemon 134850092431040)>, <Thread(tpool_thread_1, started daemon 134850084021952)>, <Thread(tpool_thread_2, started daemon 134850075612864)>, <Thread(tpool_thread_3, started daemon 134850067203776)>, <Thread(tpool_thread_4, started daemon 134850058794688)>, <Thread(tpool_thread_5, started daemon 134850050385600)>, <Thread(tpool_thread_6, started daemon 134850041976512)>, <Thread(tpool_thread_7, started daemon 134850033567424)>, <Thread(tpool_thread_8, started daemon 134850025158336)>, <Thread(tpool_thread_9, started daemon 134850016749248)>, <Thread(tpool_thread_10, started daemon 134850008340160)>, <Thread(tpool_thread_11, started daemon 134849999931072)>, <Thread(tpool_thread_12, started daemon 134849991521984)>, <Thread(tpool_thread_13, started daemon 134849983112896)>, <Thread(tpool_thread_14, started daemon 134849974703808)>, <Thread(tpool_thread_15, started daemon 134849966294720)>, <Thread(tpool_thread_16, started daemon 134849957885632)>, <Thread(tpool_thread_17, started daemon 134849949476544)>, <Thread(tpool_thread_18, started daemon 134849941067456)>, <Thread(tpool_thread_19, started daemon 134849932658368)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:28:15 devstack sudo[108487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2 1073741824
Jul 03 13:28:15 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:16 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2 1073741824" returned: 0 in 0.844s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:16 devstack sudo[108492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2
Jul 03 13:28:16 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:17 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2" returned: 0 in 0.632s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:17 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:28:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:28:17 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fadb8f14-de28-4c95-93c9-28a7215383c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-997f48c4-73c1-402c-be72-d97a8fe0eba2', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:28:17 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01cbea3-240d-4add-81b5-45b0f3e1ffb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:28:17 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Volume volume-997f48c4-73c1-402c-be72-d97a8fe0eba2 (997f48c4-73c1-402c-be72-d97a8fe0eba2): created successfully
Jul 03 13:28:17 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01cbea3-240d-4add-81b5-45b0f3e1ffb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:28:17 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Flow 'volume_create_manager' (86beb1b4-1b0e-48af-b49e-d74033fc0f93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:28:17 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-edab05ef-c815-44da-9635-22fef30ac0c0 tempest-ProjectReaderTests-1717421477 None] Created volume successfully.
Jul 03 13:28:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-65be2505-bdc9-4d46-84b6-eea74f546296 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:28:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-65be2505-bdc9-4d46-84b6-eea74f546296 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:28:17 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-65be2505-bdc9-4d46-84b6-eea74f546296 tempest-ProjectReaderTests-1717421477 None] Creating offline snapshot 959ade5a-6aa9-4ee4-afdf-585331e7ed46 of volume 997f48c4-73c1-402c-be72-d97a8fe0eba2 {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:28:17 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf82acf-6d48-44ad-94e8-951b1dacb747]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:28:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-65be2505-bdc9-4d46-84b6-eea74f546296 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:18 devstack sudo[108495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2
Jul 03 13:28:18 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:18 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-65be2505-bdc9-4d46-84b6-eea74f546296 tempest-ProjectReaderTests-1717421477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2" returned: 0 in 0.753s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-65be2505-bdc9-4d46-84b6-eea74f546296 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2.959ade5a-6aa9-4ee4-afdf-585331e7ed46 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:18 devstack sudo[108500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2.959ade5a-6aa9-4ee4-afdf-585331e7ed46 1G
Jul 03 13:28:18 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:19 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-65be2505-bdc9-4d46-84b6-eea74f546296 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2.959ade5a-6aa9-4ee4-afdf-585331e7ed46 1G" returned: 0 in 0.748s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-65be2505-bdc9-4d46-84b6-eea74f546296 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-997f48c4-73c1-402c-be72-d97a8fe0eba2 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2.959ade5a-6aa9-4ee4-afdf-585331e7ed46 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:19 devstack sudo[108505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-997f48c4-73c1-402c-be72-d97a8fe0eba2 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2.959ade5a-6aa9-4ee4-afdf-585331e7ed46
Jul 03 13:28:19 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:20 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-65be2505-bdc9-4d46-84b6-eea74f546296 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-997f48c4-73c1-402c-be72-d97a8fe0eba2 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2.959ade5a-6aa9-4ee4-afdf-585331e7ed46" returned: 0 in 0.662s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:20 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-65be2505-bdc9-4d46-84b6-eea74f546296 tempest-ProjectReaderTests-1717421477 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2.959ade5a-6aa9-4ee4-afdf-585331e7ed46 is being set with open permissions: ugo+rw
Jul 03 13:28:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-65be2505-bdc9-4d46-84b6-eea74f546296 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2.959ade5a-6aa9-4ee4-afdf-585331e7ed46 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:20 devstack sudo[108510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2.959ade5a-6aa9-4ee4-afdf-585331e7ed46
Jul 03 13:28:20 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:20 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-65be2505-bdc9-4d46-84b6-eea74f546296 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2.959ade5a-6aa9-4ee4-afdf-585331e7ed46" returned: 0 in 0.605s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-65be2505-bdc9-4d46-84b6-eea74f546296 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:20 devstack sudo[108513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2.info
Jul 03 13:28:20 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:21 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-65be2505-bdc9-4d46-84b6-eea74f546296 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2.info" returned: 0 in 0.619s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:21 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-65be2505-bdc9-4d46-84b6-eea74f546296 tempest-ProjectReaderTests-1717421477 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2.info is being set with open permissions: ugo+rw
Jul 03 13:28:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-65be2505-bdc9-4d46-84b6-eea74f546296 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:21 devstack sudo[108516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2.info
Jul 03 13:28:21 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:22 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-65be2505-bdc9-4d46-84b6-eea74f546296 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2.info" returned: 0 in 0.679s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-65be2505-bdc9-4d46-84b6-eea74f546296 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.148s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:28:22 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-65be2505-bdc9-4d46-84b6-eea74f546296 tempest-ProjectReaderTests-1717421477 None] Create snapshot completed successfully
Jul 03 13:28:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4ddcd0a1-2a15-4295-bfcc-1309fcd27261 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "cinder-959ade5a-6aa9-4ee4-afdf-585331e7ed46-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:28:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4ddcd0a1-2a15-4295-bfcc-1309fcd27261 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-959ade5a-6aa9-4ee4-afdf-585331e7ed46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:28:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4ddcd0a1-2a15-4295-bfcc-1309fcd27261 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "cinder-quobyte-997f48c4-73c1-402c-be72-d97a8fe0eba2" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:28:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4ddcd0a1-2a15-4295-bfcc-1309fcd27261 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-997f48c4-73c1-402c-be72-d97a8fe0eba2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:28:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4ddcd0a1-2a15-4295-bfcc-1309fcd27261 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "cinder-quobyte-959ade5a-6aa9-4ee4-afdf-585331e7ed46" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:28:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4ddcd0a1-2a15-4295-bfcc-1309fcd27261 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-959ade5a-6aa9-4ee4-afdf-585331e7ed46" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:28:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-4ddcd0a1-2a15-4295-bfcc-1309fcd27261 tempest-ProjectReaderTests-1717421477 None] Deleting offline snapshot 959ade5a-6aa9-4ee4-afdf-585331e7ed46 of volume 997f48c4-73c1-402c-be72-d97a8fe0eba2 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:28:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-4ddcd0a1-2a15-4295-bfcc-1309fcd27261 tempest-ProjectReaderTests-1717421477 None] snapshot_file for this snap is: volume-997f48c4-73c1-402c-be72-d97a8fe0eba2.959ade5a-6aa9-4ee4-afdf-585331e7ed46 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:28:23 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71515b4-1945-4fce-8abb-6b515a94672c]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:28:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4ddcd0a1-2a15-4295-bfcc-1309fcd27261 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2.959ade5a-6aa9-4ee4-afdf-585331e7ed46 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:23 devstack sudo[108519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2.959ade5a-6aa9-4ee4-afdf-585331e7ed46
Jul 03 13:28:23 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:24 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4ddcd0a1-2a15-4295-bfcc-1309fcd27261 tempest-ProjectReaderTests-1717421477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2.959ade5a-6aa9-4ee4-afdf-585331e7ed46" returned: 0 in 0.784s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-4ddcd0a1-2a15-4295-bfcc-1309fcd27261 tempest-ProjectReaderTests-1717421477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-997f48c4-73c1-402c-be72-d97a8fe0eba2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:28:24 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81d22a8-af7d-45f1-a846-0eb46831620a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:28:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4ddcd0a1-2a15-4295-bfcc-1309fcd27261 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:24 devstack sudo[108531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2
Jul 03 13:28:24 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:24 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4ddcd0a1-2a15-4295-bfcc-1309fcd27261 tempest-ProjectReaderTests-1717421477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2" returned: 0 in 0.761s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4ddcd0a1-2a15-4295-bfcc-1309fcd27261 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2.959ade5a-6aa9-4ee4-afdf-585331e7ed46 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:24 devstack sudo[108537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2.959ade5a-6aa9-4ee4-afdf-585331e7ed46
Jul 03 13:28:24 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:25 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4ddcd0a1-2a15-4295-bfcc-1309fcd27261 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2.959ade5a-6aa9-4ee4-afdf-585331e7ed46" returned: 0 in 0.731s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4ddcd0a1-2a15-4295-bfcc-1309fcd27261 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2.959ade5a-6aa9-4ee4-afdf-585331e7ed46 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:25 devstack sudo[108542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2.959ade5a-6aa9-4ee4-afdf-585331e7ed46
Jul 03 13:28:25 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:26 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4ddcd0a1-2a15-4295-bfcc-1309fcd27261 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2.959ade5a-6aa9-4ee4-afdf-585331e7ed46" returned: 0 in 0.620s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:26 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4ddcd0a1-2a15-4295-bfcc-1309fcd27261 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-959ade5a-6aa9-4ee4-afdf-585331e7ed46" released by "_delete_snapshot" :: held 2.993s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:28:26 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4ddcd0a1-2a15-4295-bfcc-1309fcd27261 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-997f48c4-73c1-402c-be72-d97a8fe0eba2" released by "delete_snapshot" :: held 3.015s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:28:26 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-4ddcd0a1-2a15-4295-bfcc-1309fcd27261 tempest-ProjectReaderTests-1717421477 None] Created reservations ['270b3fcf-fbe9-4ee0-ba71-f90a0df28846', '85946b4d-0fb9-4c62-99d6-bb809d7351c7', '7f39450d-979f-484a-b393-3b75750bfff5', 'f18f719b-d385-4911-b7f5-90633d475529'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:28:26 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-4ddcd0a1-2a15-4295-bfcc-1309fcd27261 tempest-ProjectReaderTests-1717421477 None] Delete snapshot completed successfully.
Jul 03 13:28:26 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4ddcd0a1-2a15-4295-bfcc-1309fcd27261 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-959ade5a-6aa9-4ee4-afdf-585331e7ed46-delete_snapshot" released by "delete_snapshot" :: held 3.152s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:28:27 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a16fdd64-99c1-498c-b3fd-6b15426fda95 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "cinder-997f48c4-73c1-402c-be72-d97a8fe0eba2-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:28:27 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a16fdd64-99c1-498c-b3fd-6b15426fda95 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-997f48c4-73c1-402c-be72-d97a8fe0eba2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:28:27 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a16fdd64-99c1-498c-b3fd-6b15426fda95 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "cinder-quobyte-997f48c4-73c1-402c-be72-d97a8fe0eba2" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:28:27 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a16fdd64-99c1-498c-b3fd-6b15426fda95 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-997f48c4-73c1-402c-be72-d97a8fe0eba2" acquired by "delete_volume" :: waited 0.024s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:28:27 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c54c7c-b14d-490f-a98b-462f7373503d]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:28:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a16fdd64-99c1-498c-b3fd-6b15426fda95 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:27 devstack sudo[108581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2
Jul 03 13:28:27 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:28 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a16fdd64-99c1-498c-b3fd-6b15426fda95 tempest-ProjectReaderTests-1717421477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2" returned: 0 in 0.819s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a16fdd64-99c1-498c-b3fd-6b15426fda95 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:28 devstack sudo[108586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2
Jul 03 13:28:28 devstack sudo[108586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:29 devstack sudo[108586]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a16fdd64-99c1-498c-b3fd-6b15426fda95 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-997f48c4-73c1-402c-be72-d97a8fe0eba2" returned: 0 in 0.696s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:29 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a16fdd64-99c1-498c-b3fd-6b15426fda95 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-997f48c4-73c1-402c-be72-d97a8fe0eba2" released by "delete_volume" :: held 1.579s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:28:29 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-a16fdd64-99c1-498c-b3fd-6b15426fda95 tempest-ProjectReaderTests-1717421477 None] Created reservations ['db094645-0bee-4ab2-b475-11b341c85e72', '39b8ebc0-55d8-462e-8a95-980d4988f2d9', '56c109ce-b701-492b-bd95-38bc8336249a', '5dc3f22f-455a-4f52-8639-88282701b31f'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:28:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a16fdd64-99c1-498c-b3fd-6b15426fda95 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:28:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a16fdd64-99c1-498c-b3fd-6b15426fda95 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:28:29 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a16fdd64-99c1-498c-b3fd-6b15426fda95 tempest-ProjectReaderTests-1717421477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:28:29 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a16fdd64-99c1-498c-b3fd-6b15426fda95 tempest-ProjectReaderTests-1717421477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:28:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a16fdd64-99c1-498c-b3fd-6b15426fda95 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:28:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a16fdd64-99c1-498c-b3fd-6b15426fda95 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:29 devstack sudo[108589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:28:29 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:29 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a16fdd64-99c1-498c-b3fd-6b15426fda95 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.629s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:29 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-a16fdd64-99c1-498c-b3fd-6b15426fda95 tempest-ProjectReaderTests-1717421477 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:28:29 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-a16fdd64-99c1-498c-b3fd-6b15426fda95 tempest-ProjectReaderTests-1717421477 None] Deleted volume successfully.
Jul 03 13:28:29 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a16fdd64-99c1-498c-b3fd-6b15426fda95 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-997f48c4-73c1-402c-be72-d97a8fe0eba2-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:28:30 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:28:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Flow 'volume_create_manager' (e6f29323-f6c4-4107-8bc1-38f630c37c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:28:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5745d483-897a-483a-97ab-2d82ab602538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:28:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5745d483-897a-483a-97ab-2d82ab602538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-691439409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ee5b19-9f28-4cc6-aa2d-77264f12bfa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9b9895e6094ba491a40e642c6a03b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:28:30Z,use_quota=True,user_id='8fca7bfb7d5b44a6a8b3f9e7153bf18a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:28:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d3bd422-13de-4849-9b79-36ecb4ccc300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:28:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d3bd422-13de-4849-9b79-36ecb4ccc300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:28:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da67881-6d98-4b5c-98e1-7238337203c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:28:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da67881-6d98-4b5c-98e1-7238337203c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76ee5b19-9f28-4cc6-aa2d-77264f12bfa8', 'volume_name': 'volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:28:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce6c99b-efff-4954-8ecb-63688cf6411f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:28:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce6c99b-efff-4954-8ecb-63688cf6411f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:28:30 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12085da4-c758-4b7d-a1f3-930a733283f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:28:30 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Volume 76ee5b19-9f28-4cc6-aa2d-77264f12bfa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8', 'volume_size': 1}
Jul 03 13:28:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:28:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:28:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-691439409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ee5b19-9f28-4cc6-aa2d-77264f12bfa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9b9895e6094ba491a40e642c6a03b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:28:30Z,use_quota=True,user_id='8fca7bfb7d5b44a6a8b3f9e7153bf18a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:28:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Creating volume 76ee5b19-9f28-4cc6-aa2d-77264f12bfa8 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:28:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:28:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:28:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:28:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:28:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:28:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:28:30 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:28:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:30 devstack sudo[108592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8 1073741824
Jul 03 13:28:30 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:31 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8 1073741824" returned: 0 in 0.855s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:31 devstack sudo[108597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8
Jul 03 13:28:31 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:31 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8" returned: 0 in 0.654s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:28:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:28:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12085da4-c758-4b7d-a1f3-930a733283f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:28:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340bddcc-0221-48c3-b520-e602b44ca2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:28:31 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Volume volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8 (76ee5b19-9f28-4cc6-aa2d-77264f12bfa8): created successfully
Jul 03 13:28:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340bddcc-0221-48c3-b520-e602b44ca2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:28:31 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Flow 'volume_create_manager' (e6f29323-f6c4-4107-8bc1-38f630c37c8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:28:31 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-b1aae80f-2788-42a9-8522-8b70f77880b1 tempest-ProjectReaderTests-1717421477 None] Created volume successfully.
Jul 03 13:28:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a3c05db2-d2ed-42a9-95e2-d37de34e0f99 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:28:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a3c05db2-d2ed-42a9-95e2-d37de34e0f99 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:28:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-a3c05db2-d2ed-42a9-95e2-d37de34e0f99 tempest-ProjectReaderTests-1717421477 None] Creating offline snapshot fb6846dd-98cf-415e-9509-825d8133e437 of volume 76ee5b19-9f28-4cc6-aa2d-77264f12bfa8 {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:28:32 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcda1f67-49fc-44f8-88cd-6b017ba38aab]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:28:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a3c05db2-d2ed-42a9-95e2-d37de34e0f99 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:32 devstack sudo[108600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8
Jul 03 13:28:32 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:33 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a3c05db2-d2ed-42a9-95e2-d37de34e0f99 tempest-ProjectReaderTests-1717421477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8" returned: 0 in 0.748s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a3c05db2-d2ed-42a9-95e2-d37de34e0f99 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8.fb6846dd-98cf-415e-9509-825d8133e437 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:33 devstack sudo[108605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8.fb6846dd-98cf-415e-9509-825d8133e437 1G
Jul 03 13:28:33 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:34 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a3c05db2-d2ed-42a9-95e2-d37de34e0f99 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8.fb6846dd-98cf-415e-9509-825d8133e437 1G" returned: 0 in 0.864s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a3c05db2-d2ed-42a9-95e2-d37de34e0f99 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8.fb6846dd-98cf-415e-9509-825d8133e437 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:34 devstack sudo[108611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8.fb6846dd-98cf-415e-9509-825d8133e437
Jul 03 13:28:34 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:34 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a3c05db2-d2ed-42a9-95e2-d37de34e0f99 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8.fb6846dd-98cf-415e-9509-825d8133e437" returned: 0 in 0.668s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:34 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-a3c05db2-d2ed-42a9-95e2-d37de34e0f99 tempest-ProjectReaderTests-1717421477 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8.fb6846dd-98cf-415e-9509-825d8133e437 is being set with open permissions: ugo+rw
Jul 03 13:28:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a3c05db2-d2ed-42a9-95e2-d37de34e0f99 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8.fb6846dd-98cf-415e-9509-825d8133e437 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:34 devstack sudo[108616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8.fb6846dd-98cf-415e-9509-825d8133e437
Jul 03 13:28:34 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:35 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a3c05db2-d2ed-42a9-95e2-d37de34e0f99 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8.fb6846dd-98cf-415e-9509-825d8133e437" returned: 0 in 0.663s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a3c05db2-d2ed-42a9-95e2-d37de34e0f99 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:35 devstack sudo[108619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8.info
Jul 03 13:28:35 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:36 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a3c05db2-d2ed-42a9-95e2-d37de34e0f99 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8.info" returned: 0 in 0.627s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:36 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-a3c05db2-d2ed-42a9-95e2-d37de34e0f99 tempest-ProjectReaderTests-1717421477 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8.info is being set with open permissions: ugo+rw
Jul 03 13:28:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a3c05db2-d2ed-42a9-95e2-d37de34e0f99 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:36 devstack sudo[108622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8.info
Jul 03 13:28:36 devstack sudo[108622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:36 devstack sudo[108622]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a3c05db2-d2ed-42a9-95e2-d37de34e0f99 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8.info" returned: 0 in 0.631s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a3c05db2-d2ed-42a9-95e2-d37de34e0f99 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.282s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:28:36 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-a3c05db2-d2ed-42a9-95e2-d37de34e0f99 tempest-ProjectReaderTests-1717421477 None] Create snapshot completed successfully
Jul 03 13:28:37 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3f6d4472-06f6-4cff-9f1d-3e6f73038d29 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "cinder-fb6846dd-98cf-415e-9509-825d8133e437-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:28:37 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3f6d4472-06f6-4cff-9f1d-3e6f73038d29 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-fb6846dd-98cf-415e-9509-825d8133e437-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:28:37 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3f6d4472-06f6-4cff-9f1d-3e6f73038d29 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "cinder-quobyte-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:28:37 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3f6d4472-06f6-4cff-9f1d-3e6f73038d29 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:28:37 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3f6d4472-06f6-4cff-9f1d-3e6f73038d29 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "cinder-quobyte-fb6846dd-98cf-415e-9509-825d8133e437" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:28:37 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3f6d4472-06f6-4cff-9f1d-3e6f73038d29 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-fb6846dd-98cf-415e-9509-825d8133e437" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:28:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-3f6d4472-06f6-4cff-9f1d-3e6f73038d29 tempest-ProjectReaderTests-1717421477 None] Deleting offline snapshot fb6846dd-98cf-415e-9509-825d8133e437 of volume 76ee5b19-9f28-4cc6-aa2d-77264f12bfa8 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:28:37 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-3f6d4472-06f6-4cff-9f1d-3e6f73038d29 tempest-ProjectReaderTests-1717421477 None] snapshot_file for this snap is: volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8.fb6846dd-98cf-415e-9509-825d8133e437 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:28:37 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcc52ce-b6f1-4066-beab-d0b4e2cc9172]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:28:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3f6d4472-06f6-4cff-9f1d-3e6f73038d29 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8.fb6846dd-98cf-415e-9509-825d8133e437 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:37 devstack sudo[108625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8.fb6846dd-98cf-415e-9509-825d8133e437
Jul 03 13:28:37 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:38 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3f6d4472-06f6-4cff-9f1d-3e6f73038d29 tempest-ProjectReaderTests-1717421477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8.fb6846dd-98cf-415e-9509-825d8133e437" returned: 0 in 0.755s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:38 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-3f6d4472-06f6-4cff-9f1d-3e6f73038d29 tempest-ProjectReaderTests-1717421477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:28:38 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6059f69-b814-4711-9c6e-ab3c737c1bc2]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:28:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3f6d4472-06f6-4cff-9f1d-3e6f73038d29 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:38 devstack sudo[108630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8
Jul 03 13:28:38 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:39 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3f6d4472-06f6-4cff-9f1d-3e6f73038d29 tempest-ProjectReaderTests-1717421477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8" returned: 0 in 0.729s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3f6d4472-06f6-4cff-9f1d-3e6f73038d29 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8.fb6846dd-98cf-415e-9509-825d8133e437 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:39 devstack sudo[108635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8.fb6846dd-98cf-415e-9509-825d8133e437
Jul 03 13:28:39 devstack sudo[108635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:39 devstack sudo[108635]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3f6d4472-06f6-4cff-9f1d-3e6f73038d29 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8.fb6846dd-98cf-415e-9509-825d8133e437" returned: 0 in 0.724s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3f6d4472-06f6-4cff-9f1d-3e6f73038d29 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8.fb6846dd-98cf-415e-9509-825d8133e437 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:39 devstack sudo[108640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8.fb6846dd-98cf-415e-9509-825d8133e437
Jul 03 13:28:39 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:40 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-3f6d4472-06f6-4cff-9f1d-3e6f73038d29 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8.fb6846dd-98cf-415e-9509-825d8133e437" returned: 0 in 0.688s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3f6d4472-06f6-4cff-9f1d-3e6f73038d29 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-fb6846dd-98cf-415e-9509-825d8133e437" released by "_delete_snapshot" :: held 2.987s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:28:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3f6d4472-06f6-4cff-9f1d-3e6f73038d29 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8" released by "delete_snapshot" :: held 3.009s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:28:40 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-3f6d4472-06f6-4cff-9f1d-3e6f73038d29 tempest-ProjectReaderTests-1717421477 None] Created reservations ['dbdb4753-2704-4f40-9f39-82215356cb49', 'b8876550-82a2-462d-825a-d701d8dcdd1d', '33fbf6ae-9577-4228-ac89-1fabdc1d411d', '700de85b-e79c-4ba7-982e-c6ff0339f3f9'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:28:40 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-3f6d4472-06f6-4cff-9f1d-3e6f73038d29 tempest-ProjectReaderTests-1717421477 None] Delete snapshot completed successfully.
Jul 03 13:28:40 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-3f6d4472-06f6-4cff-9f1d-3e6f73038d29 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-fb6846dd-98cf-415e-9509-825d8133e437-delete_snapshot" released by "delete_snapshot" :: held 3.148s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:28:41 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0e87a5be-19ec-4f17-acc2-2c190cd364c9 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "cinder-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:28:41 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0e87a5be-19ec-4f17-acc2-2c190cd364c9 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:28:41 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0e87a5be-19ec-4f17-acc2-2c190cd364c9 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "cinder-quobyte-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:28:41 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0e87a5be-19ec-4f17-acc2-2c190cd364c9 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8" acquired by "delete_volume" :: waited 0.016s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:28:41 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e867867-5a5f-4cc3-b34e-b430f5571321]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:28:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0e87a5be-19ec-4f17-acc2-2c190cd364c9 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:42 devstack sudo[108643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8
Jul 03 13:28:42 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:42 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0e87a5be-19ec-4f17-acc2-2c190cd364c9 tempest-ProjectReaderTests-1717421477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8" returned: 0 in 0.743s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0e87a5be-19ec-4f17-acc2-2c190cd364c9 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:42 devstack sudo[108648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8
Jul 03 13:28:42 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:43 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0e87a5be-19ec-4f17-acc2-2c190cd364c9 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8" returned: 0 in 0.656s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:43 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0e87a5be-19ec-4f17-acc2-2c190cd364c9 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-quobyte-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8" released by "delete_volume" :: held 1.458s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:28:43 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-0e87a5be-19ec-4f17-acc2-2c190cd364c9 tempest-ProjectReaderTests-1717421477 None] Created reservations ['b4b2d3cd-2a32-4e3a-8254-e0e8440db48f', '69a1f519-25dc-408d-828a-175def367213', '7431a239-9ed3-4112-8e3c-87c4cd77b7ae', '83698310-58bc-46da-ac49-da05c1c6ecd8'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:28:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0e87a5be-19ec-4f17-acc2-2c190cd364c9 tempest-ProjectReaderTests-1717421477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:28:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0e87a5be-19ec-4f17-acc2-2c190cd364c9 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:28:43 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0e87a5be-19ec-4f17-acc2-2c190cd364c9 tempest-ProjectReaderTests-1717421477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:28:43 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0e87a5be-19ec-4f17-acc2-2c190cd364c9 tempest-ProjectReaderTests-1717421477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:28:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0e87a5be-19ec-4f17-acc2-2c190cd364c9 tempest-ProjectReaderTests-1717421477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:28:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0e87a5be-19ec-4f17-acc2-2c190cd364c9 tempest-ProjectReaderTests-1717421477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:28:43 devstack sudo[108652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:28:43 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:28:44 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root
Jul 03 13:28:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0e87a5be-19ec-4f17-acc2-2c190cd364c9 tempest-ProjectReaderTests-1717421477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.626s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:28:44 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-0e87a5be-19ec-4f17-acc2-2c190cd364c9 tempest-ProjectReaderTests-1717421477 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:28:44 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-0e87a5be-19ec-4f17-acc2-2c190cd364c9 tempest-ProjectReaderTests-1717421477 None] Deleted volume successfully.
Jul 03 13:28:44 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0e87a5be-19ec-4f17-acc2-2c190cd364c9 tempest-ProjectReaderTests-1717421477 None] Lock "cinder-76ee5b19-9f28-4cc6-aa2d-77264f12bfa8-delete_volume" released by "delete_volume" :: held 2.286s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:28:53 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:UPDATE=52,cinder:SELECT=39,cinder:INSERT=12,cinder:DELETE=4 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:29:00 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=46,cinder:UPDATE=57,cinder:DELETE=5,cinder:INSERT=18 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:29:07 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:29:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Flow 'volume_create_manager' (8f2a976c-cbf3-4164-aa83-e92dde6174b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:29:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75bc5157-045f-4ac5-8bab-513798d09a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:29:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75bc5157-045f-4ac5-8bab-513798d09a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-874159245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55087587-c454-456c-9d57-4b4796001545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d95f8ca4aa7840849160b7a4b14be5a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:29:08Z,use_quota=True,user_id='cf171423d4224e67b42bc6353309e173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:29:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e1c868-9228-430a-b321-92751809cafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:29:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e1c868-9228-430a-b321-92751809cafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:29:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa7e6b5-6b78-4cc6-b242-41439841ca32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:29:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa7e6b5-6b78-4cc6-b242-41439841ca32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55087587-c454-456c-9d57-4b4796001545', 'volume_name': 'volume-55087587-c454-456c-9d57-4b4796001545', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:29:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57aa017-f20d-4dda-ab48-a8e79b226293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:29:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57aa017-f20d-4dda-ab48-a8e79b226293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:29:07 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e791624d-1b33-4dac-bf25-73f51daece0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:29:07 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Volume 55087587-c454-456c-9d57-4b4796001545: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55087587-c454-456c-9d57-4b4796001545', 'volume_size': 1}
Jul 03 13:29:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:29:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:29:07 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-874159245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55087587-c454-456c-9d57-4b4796001545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d95f8ca4aa7840849160b7a4b14be5a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:29:08Z,use_quota=True,user_id='cf171423d4224e67b42bc6353309e173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:29:07 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Creating volume 55087587-c454-456c-9d57-4b4796001545 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:29:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:29:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:29:07 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:29:07 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:29:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:29:07 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:29:07 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:29:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:29:07 devstack sudo[108662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545 1073741824
Jul 03 13:29:07 devstack sudo[108662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:29:08 devstack sudo[108662]: pam_unix(sudo:session): session closed for user root
Jul 03 13:29:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545 1073741824" returned: 0 in 0.794s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:29:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:29:08 devstack sudo[108668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545
Jul 03 13:29:08 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:29:09 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root
Jul 03 13:29:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545" returned: 0 in 0.627s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:29:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:29:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:29:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e791624d-1b33-4dac-bf25-73f51daece0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55087587-c454-456c-9d57-4b4796001545', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:29:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c07902-65cd-4edc-939b-360f78ad80c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:29:09 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Volume volume-55087587-c454-456c-9d57-4b4796001545 (55087587-c454-456c-9d57-4b4796001545): created successfully
Jul 03 13:29:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c07902-65cd-4edc-939b-360f78ad80c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:29:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Flow 'volume_create_manager' (8f2a976c-cbf3-4164-aa83-e92dde6174b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:29:09 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-b4a848bf-25be-47f3-b94d-db7dfd3e87cb tempest-SnapshotDependencyTests-306740303 None] Created volume successfully.
Jul 03 13:29:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f9a34cfa-6dbd-4eea-bee4-763ca5c6f4d4 tempest-SnapshotDependencyTests-306740303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:29:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f9a34cfa-6dbd-4eea-bee4-763ca5c6f4d4 tempest-SnapshotDependencyTests-306740303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:29:10 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-f9a34cfa-6dbd-4eea-bee4-763ca5c6f4d4 tempest-SnapshotDependencyTests-306740303 None] Creating offline snapshot 98419276-ab1a-498b-a01b-2e66b6b395a2 of volume 55087587-c454-456c-9d57-4b4796001545 {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:29:10 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c532b92e-0a4d-4b2f-a9c1-ef633da94cb7]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:29:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f9a34cfa-6dbd-4eea-bee4-763ca5c6f4d4 tempest-SnapshotDependencyTests-306740303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:29:10 devstack sudo[108672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545
Jul 03 13:29:10 devstack sudo[108672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:29:10 devstack sudo[108672]: pam_unix(sudo:session): session closed for user root
Jul 03 13:29:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f9a34cfa-6dbd-4eea-bee4-763ca5c6f4d4 tempest-SnapshotDependencyTests-306740303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545" returned: 0 in 0.770s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:29:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f9a34cfa-6dbd-4eea-bee4-763ca5c6f4d4 tempest-SnapshotDependencyTests-306740303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.98419276-ab1a-498b-a01b-2e66b6b395a2 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:29:10 devstack sudo[108678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.98419276-ab1a-498b-a01b-2e66b6b395a2 1G
Jul 03 13:29:10 devstack sudo[108678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:29:11 devstack sudo[108678]: pam_unix(sudo:session): session closed for user root
Jul 03 13:29:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f9a34cfa-6dbd-4eea-bee4-763ca5c6f4d4 tempest-SnapshotDependencyTests-306740303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.98419276-ab1a-498b-a01b-2e66b6b395a2 1G" returned: 0 in 0.771s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:29:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f9a34cfa-6dbd-4eea-bee4-763ca5c6f4d4 tempest-SnapshotDependencyTests-306740303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55087587-c454-456c-9d57-4b4796001545 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.98419276-ab1a-498b-a01b-2e66b6b395a2 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:29:11 devstack sudo[108684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55087587-c454-456c-9d57-4b4796001545 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.98419276-ab1a-498b-a01b-2e66b6b395a2
Jul 03 13:29:11 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:29:12 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root
Jul 03 13:29:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f9a34cfa-6dbd-4eea-bee4-763ca5c6f4d4 tempest-SnapshotDependencyTests-306740303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55087587-c454-456c-9d57-4b4796001545 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.98419276-ab1a-498b-a01b-2e66b6b395a2" returned: 0 in 0.682s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:29:12 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-f9a34cfa-6dbd-4eea-bee4-763ca5c6f4d4 tempest-SnapshotDependencyTests-306740303 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.98419276-ab1a-498b-a01b-2e66b6b395a2 is being set with open permissions: ugo+rw
Jul 03 13:29:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f9a34cfa-6dbd-4eea-bee4-763ca5c6f4d4 tempest-SnapshotDependencyTests-306740303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.98419276-ab1a-498b-a01b-2e66b6b395a2 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:29:12 devstack sudo[108689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.98419276-ab1a-498b-a01b-2e66b6b395a2
Jul 03 13:29:12 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:29:13 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root
Jul 03 13:29:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f9a34cfa-6dbd-4eea-bee4-763ca5c6f4d4 tempest-SnapshotDependencyTests-306740303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.98419276-ab1a-498b-a01b-2e66b6b395a2" returned: 0 in 0.638s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:29:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f9a34cfa-6dbd-4eea-bee4-763ca5c6f4d4 tempest-SnapshotDependencyTests-306740303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:29:13 devstack sudo[108692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.info
Jul 03 13:29:13 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:29:13 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root
Jul 03 13:29:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f9a34cfa-6dbd-4eea-bee4-763ca5c6f4d4 tempest-SnapshotDependencyTests-306740303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.info" returned: 0 in 0.649s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:29:13 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-f9a34cfa-6dbd-4eea-bee4-763ca5c6f4d4 tempest-SnapshotDependencyTests-306740303 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.info is being set with open permissions: ugo+rw
Jul 03 13:29:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f9a34cfa-6dbd-4eea-bee4-763ca5c6f4d4 tempest-SnapshotDependencyTests-306740303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:29:13 devstack sudo[108696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.info
Jul 03 13:29:13 devstack sudo[108696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:29:14 devstack sudo[108696]: pam_unix(sudo:session): session closed for user root
Jul 03 13:29:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f9a34cfa-6dbd-4eea-bee4-763ca5c6f4d4 tempest-SnapshotDependencyTests-306740303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.info" returned: 0 in 0.627s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:29:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f9a34cfa-6dbd-4eea-bee4-763ca5c6f4d4 tempest-SnapshotDependencyTests-306740303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.215s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:29:14 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-f9a34cfa-6dbd-4eea-bee4-763ca5c6f4d4 tempest-SnapshotDependencyTests-306740303 None] Create snapshot completed successfully
Jul 03 13:29:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:29:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:29:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:29:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:29:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:29:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:29:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:29:15 devstack sudo[108699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:29:15 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:29:15 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root
Jul 03 13:29:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.636s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:29:15 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:29:15 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:29:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 28 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:29:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>, <Thread(tpool_thread_0, started daemon 134850092431040)>, <Thread(tpool_thread_1, started daemon 134850084021952)>, <Thread(tpool_thread_2, started daemon 134850075612864)>, <Thread(tpool_thread_3, started daemon 134850067203776)>, <Thread(tpool_thread_4, started daemon 134850058794688)>, <Thread(tpool_thread_5, started daemon 134850050385600)>, <Thread(tpool_thread_6, started daemon 134850041976512)>, <Thread(tpool_thread_7, started daemon 134850033567424)>, <Thread(tpool_thread_8, started daemon 134850025158336)>, <Thread(tpool_thread_9, started daemon 134850016749248)>, <Thread(tpool_thread_10, started daemon 134850008340160)>, <Thread(tpool_thread_11, started daemon 134849999931072)>, <Thread(tpool_thread_12, started daemon 134849991521984)>, <Thread(tpool_thread_13, started daemon 134849983112896)>, <Thread(tpool_thread_14, started daemon 134849974703808)>, <Thread(tpool_thread_15, started daemon 134849966294720)>, <Thread(tpool_thread_16, started daemon 134849957885632)>, <Thread(tpool_thread_17, started daemon 134849949476544)>, <Thread(tpool_thread_18, started daemon 134849941067456)>, <Thread(tpool_thread_19, started daemon 134849932658368)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:29:15 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:29:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Flow 'volume_create_manager' (cabc5131-7a53-4a25-a468-09aabb794dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:29:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6bc9334-74c2-473f-af8d-cd25c72bd874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:29:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6bc9334-74c2-473f-af8d-cd25c72bd874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d95f8ca4aa7840849160b7a4b14be5a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=98419276-ab1a-498b-a01b-2e66b6b395a2,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:29:16Z,use_quota=True,user_id='cf171423d4224e67b42bc6353309e173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:29:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5f8cd6-9d1a-46c3-9859-666a7935990a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:29:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5f8cd6-9d1a-46c3-9859-666a7935990a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:29:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5647b9c1-e081-4714-b837-90f822a3d650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:29:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5647b9c1-e081-4714-b837-90f822a3d650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7', 'volume_name': 'volume-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7', 'volume_size': 1, 'snapshot_id': '98419276-ab1a-498b-a01b-2e66b6b395a2'}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:29:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f115b291-4779-48e6-8e58-92f15f6c2c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:29:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f115b291-4779-48e6-8e58-92f15f6c2c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:29:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c137ee0-0372-499b-8cf5-79ff39171185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:29:15 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Volume ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7', 'volume_size': 1, 'snapshot_id': '98419276-ab1a-498b-a01b-2e66b6b395a2'}
Jul 03 13:29:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:29:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:29:15 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Acquiring lock "cinder-quobyte-98419276-ab1a-498b-a01b-2e66b6b395a2-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7" by "_create_volume_from_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:29:15 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Lock "cinder-quobyte-98419276-ab1a-498b-a01b-2e66b6b395a2-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:29:15 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Creating volume ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7 from snapshot 98419276-ab1a-498b-a01b-2e66b6b395a2 {{(pid=86837) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 13:29:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:29:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:29:16 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:29:16 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:29:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:29:16 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:29:16 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Acquiring lock "cinder-quobyte-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7" by "_copy_volume_from_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:29:16 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Lock "cinder-quobyte-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:29:16 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] snapshot: 98419276-ab1a-498b-a01b-2e66b6b395a2, volume: ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7,  {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 13:29:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:29:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:29:16 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:29:16 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:29:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:29:16 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b321a8-3d26-4ca5-a8f2-04066f901024]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:29:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.98419276-ab1a-498b-a01b-2e66b6b395a2 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:29:16 devstack sudo[108702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.98419276-ab1a-498b-a01b-2e66b6b395a2
Jul 03 13:29:16 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:29:16 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root
Jul 03 13:29:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.98419276-ab1a-498b-a01b-2e66b6b395a2" returned: 0 in 0.757s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:29:16 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55087587-c454-456c-9d57-4b4796001545(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:29:16 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545 {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 13:29:16 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Creating direct copy from snapshot {{(pid=86837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 13:29:16 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba310f52-aebb-45ef-9c2c-4fae4938ab91]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:29:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:29:16 devstack sudo[108707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545
Jul 03 13:29:16 devstack sudo[108707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:29:17 devstack sudo[108707]: pam_unix(sudo:session): session closed for user root
Jul 03 13:29:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545" returned: 0 in 0.749s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:29:17 devstack cinder-volume[86837]: DEBUG cinder.utils [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Path /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7 not found in is_blk_device check {{(pid=86837) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 13:29:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:29:17 devstack sudo[108712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7
Jul 03 13:29:17 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:29:21 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root
Jul 03 13:29:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7" returned: 0 in 4.390s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:29:21 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbacdb2-c73c-42df-9260-45156db75aed]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:29:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:29:22 devstack sudo[108725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545
Jul 03 13:29:22 devstack sudo[108725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:29:22 devstack sudo[108725]: pam_unix(sudo:session): session closed for user root
Jul 03 13:29:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545" returned: 0 in 0.910s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:29:22 devstack cinder-volume[86837]: DEBUG cinder.image.image_utils [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545, size 1024.00 MB, duration 4.39 sec, destination /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7 {{(pid=86837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 13:29:22 devstack cinder-volume[86837]: INFO cinder.image.image_utils [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Converted 1024.00 MB image at 233.19 MB/s
Jul 03 13:29:22 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7 is being set with open permissions: ugo+rw
Jul 03 13:29:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:29:22 devstack sudo[108730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7
Jul 03 13:29:22 devstack sudo[108730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:29:23 devstack sudo[108730]: pam_unix(sudo:session): session closed for user root
Jul 03 13:29:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7" returned: 0 in 0.653s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:29:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Lock "cinder-quobyte-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7" released by "_copy_volume_from_snapshot" :: held 7.549s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:29:23 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Lock "cinder-quobyte-98419276-ab1a-498b-a01b-2e66b6b395a2-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7" released by "_create_volume_from_snapshot" :: held 7.579s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:29:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.593s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:29:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c137ee0-0372-499b-8cf5-79ff39171185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7', 'volume_size': 1, 'snapshot_id': '98419276-ab1a-498b-a01b-2e66b6b395a2'}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:29:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5de7292e-a1b0-48f0-9407-7b12143aeb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:29:23 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Volume volume-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7 (ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7): created successfully
Jul 03 13:29:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5de7292e-a1b0-48f0-9407-7b12143aeb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:29:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Flow 'volume_create_manager' (cabc5131-7a53-4a25-a468-09aabb794dbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:29:23 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-25ed69c2-4008-4233-bee6-dddb06252c87 tempest-SnapshotDependencyTests-306740303 None] Created volume successfully.
Jul 03 13:29:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4df88873-4af4-4ee0-ad07-912b2152a031 tempest-SnapshotDependencyTests-306740303 None] Acquiring lock "cinder-98419276-ab1a-498b-a01b-2e66b6b395a2-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:29:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4df88873-4af4-4ee0-ad07-912b2152a031 tempest-SnapshotDependencyTests-306740303 None] Lock "cinder-98419276-ab1a-498b-a01b-2e66b6b395a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:29:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4df88873-4af4-4ee0-ad07-912b2152a031 tempest-SnapshotDependencyTests-306740303 None] Acquiring lock "cinder-quobyte-55087587-c454-456c-9d57-4b4796001545" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:29:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4df88873-4af4-4ee0-ad07-912b2152a031 tempest-SnapshotDependencyTests-306740303 None] Lock "cinder-quobyte-55087587-c454-456c-9d57-4b4796001545" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:29:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4df88873-4af4-4ee0-ad07-912b2152a031 tempest-SnapshotDependencyTests-306740303 None] Acquiring lock "cinder-quobyte-98419276-ab1a-498b-a01b-2e66b6b395a2" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:29:24 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4df88873-4af4-4ee0-ad07-912b2152a031 tempest-SnapshotDependencyTests-306740303 None] Lock "cinder-quobyte-98419276-ab1a-498b-a01b-2e66b6b395a2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:29:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-4df88873-4af4-4ee0-ad07-912b2152a031 tempest-SnapshotDependencyTests-306740303 None] Deleting offline snapshot 98419276-ab1a-498b-a01b-2e66b6b395a2 of volume 55087587-c454-456c-9d57-4b4796001545 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:29:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-4df88873-4af4-4ee0-ad07-912b2152a031 tempest-SnapshotDependencyTests-306740303 None] snapshot_file for this snap is: volume-55087587-c454-456c-9d57-4b4796001545.98419276-ab1a-498b-a01b-2e66b6b395a2 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:29:24 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7b4536-2335-4440-9597-32ef9eb30b1e]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:29:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4df88873-4af4-4ee0-ad07-912b2152a031 tempest-SnapshotDependencyTests-306740303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.98419276-ab1a-498b-a01b-2e66b6b395a2 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:29:24 devstack sudo[108740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.98419276-ab1a-498b-a01b-2e66b6b395a2
Jul 03 13:29:24 devstack sudo[108740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:29:25 devstack sudo[108740]: pam_unix(sudo:session): session closed for user root
Jul 03 13:29:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4df88873-4af4-4ee0-ad07-912b2152a031 tempest-SnapshotDependencyTests-306740303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.98419276-ab1a-498b-a01b-2e66b6b395a2" returned: 0 in 0.768s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:29:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-4df88873-4af4-4ee0-ad07-912b2152a031 tempest-SnapshotDependencyTests-306740303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55087587-c454-456c-9d57-4b4796001545(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:29:25 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5c0f41-b37a-4f59-9f6a-d628bf3592e4]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:29:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4df88873-4af4-4ee0-ad07-912b2152a031 tempest-SnapshotDependencyTests-306740303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:29:25 devstack sudo[108745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545
Jul 03 13:29:25 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:29:26 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root
Jul 03 13:29:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4df88873-4af4-4ee0-ad07-912b2152a031 tempest-SnapshotDependencyTests-306740303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545" returned: 0 in 0.787s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:29:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4df88873-4af4-4ee0-ad07-912b2152a031 tempest-SnapshotDependencyTests-306740303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.98419276-ab1a-498b-a01b-2e66b6b395a2 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:29:26 devstack sudo[108750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.98419276-ab1a-498b-a01b-2e66b6b395a2
Jul 03 13:29:26 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:29:26 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root
Jul 03 13:29:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4df88873-4af4-4ee0-ad07-912b2152a031 tempest-SnapshotDependencyTests-306740303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.98419276-ab1a-498b-a01b-2e66b6b395a2" returned: 0 in 0.735s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:29:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4df88873-4af4-4ee0-ad07-912b2152a031 tempest-SnapshotDependencyTests-306740303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.98419276-ab1a-498b-a01b-2e66b6b395a2 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:29:26 devstack sudo[108755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.98419276-ab1a-498b-a01b-2e66b6b395a2
Jul 03 13:29:26 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:29:27 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root
Jul 03 13:29:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4df88873-4af4-4ee0-ad07-912b2152a031 tempest-SnapshotDependencyTests-306740303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545.98419276-ab1a-498b-a01b-2e66b6b395a2" returned: 0 in 0.661s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:29:27 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4df88873-4af4-4ee0-ad07-912b2152a031 tempest-SnapshotDependencyTests-306740303 None] Lock "cinder-quobyte-98419276-ab1a-498b-a01b-2e66b6b395a2" released by "_delete_snapshot" :: held 3.046s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:29:27 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4df88873-4af4-4ee0-ad07-912b2152a031 tempest-SnapshotDependencyTests-306740303 None] Lock "cinder-quobyte-55087587-c454-456c-9d57-4b4796001545" released by "delete_snapshot" :: held 3.072s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:29:27 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-4df88873-4af4-4ee0-ad07-912b2152a031 tempest-SnapshotDependencyTests-306740303 None] Created reservations ['604030e3-9d90-4f6a-8e9b-290ec2f9bb70', 'cbc03671-e13d-403c-ae71-fff0c775147c', 'e743ee2e-087d-4911-8992-3e9fa6cf51f3', 'b1236600-784a-4777-aa41-c5ecf8157836'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:29:27 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-4df88873-4af4-4ee0-ad07-912b2152a031 tempest-SnapshotDependencyTests-306740303 None] Delete snapshot completed successfully.
Jul 03 13:29:27 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4df88873-4af4-4ee0-ad07-912b2152a031 tempest-SnapshotDependencyTests-306740303 None] Lock "cinder-98419276-ab1a-498b-a01b-2e66b6b395a2-delete_snapshot" released by "delete_snapshot" :: held 3.229s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:29:28 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4fc6b280-4f0d-4fda-a00a-144de66d864f tempest-SnapshotDependencyTests-306740303 None] Acquiring lock "cinder-55087587-c454-456c-9d57-4b4796001545-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:29:28 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4fc6b280-4f0d-4fda-a00a-144de66d864f tempest-SnapshotDependencyTests-306740303 None] Lock "cinder-55087587-c454-456c-9d57-4b4796001545-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:29:28 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4fc6b280-4f0d-4fda-a00a-144de66d864f tempest-SnapshotDependencyTests-306740303 None] Acquiring lock "cinder-quobyte-55087587-c454-456c-9d57-4b4796001545" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:29:28 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4fc6b280-4f0d-4fda-a00a-144de66d864f tempest-SnapshotDependencyTests-306740303 None] Lock "cinder-quobyte-55087587-c454-456c-9d57-4b4796001545" acquired by "delete_volume" :: waited 0.017s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:29:28 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5c8025-38a1-4554-84aa-2616c46c5ad1]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:29:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4fc6b280-4f0d-4fda-a00a-144de66d864f tempest-SnapshotDependencyTests-306740303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:29:29 devstack sudo[108794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545
Jul 03 13:29:29 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:29:29 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root
Jul 03 13:29:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4fc6b280-4f0d-4fda-a00a-144de66d864f tempest-SnapshotDependencyTests-306740303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545" returned: 0 in 0.758s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:29:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4fc6b280-4f0d-4fda-a00a-144de66d864f tempest-SnapshotDependencyTests-306740303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:29:29 devstack sudo[108799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545
Jul 03 13:29:29 devstack sudo[108799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:29:30 devstack sudo[108799]: pam_unix(sudo:session): session closed for user root
Jul 03 13:29:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4fc6b280-4f0d-4fda-a00a-144de66d864f tempest-SnapshotDependencyTests-306740303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-55087587-c454-456c-9d57-4b4796001545" returned: 0 in 0.666s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:29:30 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4fc6b280-4f0d-4fda-a00a-144de66d864f tempest-SnapshotDependencyTests-306740303 None] Lock "cinder-quobyte-55087587-c454-456c-9d57-4b4796001545" released by "delete_volume" :: held 1.485s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:29:30 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-4fc6b280-4f0d-4fda-a00a-144de66d864f tempest-SnapshotDependencyTests-306740303 None] Created reservations ['339e7bd3-2b2d-4134-97b1-4a4183e4b778', 'fe9c95da-7a0d-43fe-afe2-be2689271c75', '990baff5-c182-4b35-bdcf-71b2ecce8f40', '7d987b4c-bb5b-4be3-95da-1dfd274bc8ac'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:29:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4fc6b280-4f0d-4fda-a00a-144de66d864f tempest-SnapshotDependencyTests-306740303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:29:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4fc6b280-4f0d-4fda-a00a-144de66d864f tempest-SnapshotDependencyTests-306740303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:29:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4fc6b280-4f0d-4fda-a00a-144de66d864f tempest-SnapshotDependencyTests-306740303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:29:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-4fc6b280-4f0d-4fda-a00a-144de66d864f tempest-SnapshotDependencyTests-306740303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:29:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4fc6b280-4f0d-4fda-a00a-144de66d864f tempest-SnapshotDependencyTests-306740303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:29:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4fc6b280-4f0d-4fda-a00a-144de66d864f tempest-SnapshotDependencyTests-306740303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:29:30 devstack sudo[108802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:29:30 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:29:31 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-310ca9da-5d96-4828-9f71-e8cac1001cd2 tempest-SnapshotDependencyTests-306740303 None] Acquiring lock "cinder-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:29:31 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root
Jul 03 13:29:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4fc6b280-4f0d-4fda-a00a-144de66d864f tempest-SnapshotDependencyTests-306740303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.635s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:29:31 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-4fc6b280-4f0d-4fda-a00a-144de66d864f tempest-SnapshotDependencyTests-306740303 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:29:31 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-310ca9da-5d96-4828-9f71-e8cac1001cd2 tempest-SnapshotDependencyTests-306740303 None] Lock "cinder-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:29:31 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-4fc6b280-4f0d-4fda-a00a-144de66d864f tempest-SnapshotDependencyTests-306740303 None] Deleted volume successfully.
Jul 03 13:29:31 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-4fc6b280-4f0d-4fda-a00a-144de66d864f tempest-SnapshotDependencyTests-306740303 None] Lock "cinder-55087587-c454-456c-9d57-4b4796001545-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:29:31 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-310ca9da-5d96-4828-9f71-e8cac1001cd2 tempest-SnapshotDependencyTests-306740303 None] Acquiring lock "cinder-quobyte-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:29:31 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-310ca9da-5d96-4828-9f71-e8cac1001cd2 tempest-SnapshotDependencyTests-306740303 None] Lock "cinder-quobyte-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7" acquired by "delete_volume" :: waited 0.014s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:29:31 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4a4f4b-fcd6-4ed3-a6ce-bf2fd0a93138]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:29:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-310ca9da-5d96-4828-9f71-e8cac1001cd2 tempest-SnapshotDependencyTests-306740303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:29:31 devstack sudo[108805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7
Jul 03 13:29:31 devstack sudo[108805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:29:31 devstack sudo[108805]: pam_unix(sudo:session): session closed for user root
Jul 03 13:29:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-310ca9da-5d96-4828-9f71-e8cac1001cd2 tempest-SnapshotDependencyTests-306740303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7" returned: 0 in 0.763s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:29:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-310ca9da-5d96-4828-9f71-e8cac1001cd2 tempest-SnapshotDependencyTests-306740303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:29:31 devstack sudo[108810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7
Jul 03 13:29:31 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:29:32 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root
Jul 03 13:29:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-310ca9da-5d96-4828-9f71-e8cac1001cd2 tempest-SnapshotDependencyTests-306740303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7" returned: 0 in 0.673s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:29:32 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-310ca9da-5d96-4828-9f71-e8cac1001cd2 tempest-SnapshotDependencyTests-306740303 None] Lock "cinder-quobyte-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7" released by "delete_volume" :: held 1.475s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:29:32 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-310ca9da-5d96-4828-9f71-e8cac1001cd2 tempest-SnapshotDependencyTests-306740303 None] Created reservations ['0b937c8c-4340-450b-9ecf-0a170590507c', '5609097a-6127-46e5-a78d-4f394449ed3f', 'd14d3e4a-f2c4-40d0-8b79-9d1a2ebf27ea', 'ae372370-69a5-49b1-8cc5-50f70d4310a8'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:29:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-310ca9da-5d96-4828-9f71-e8cac1001cd2 tempest-SnapshotDependencyTests-306740303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:29:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-310ca9da-5d96-4828-9f71-e8cac1001cd2 tempest-SnapshotDependencyTests-306740303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:29:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-310ca9da-5d96-4828-9f71-e8cac1001cd2 tempest-SnapshotDependencyTests-306740303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:29:32 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-310ca9da-5d96-4828-9f71-e8cac1001cd2 tempest-SnapshotDependencyTests-306740303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:29:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-310ca9da-5d96-4828-9f71-e8cac1001cd2 tempest-SnapshotDependencyTests-306740303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:29:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-310ca9da-5d96-4828-9f71-e8cac1001cd2 tempest-SnapshotDependencyTests-306740303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:29:32 devstack sudo[108813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:29:32 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:29:33 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root
Jul 03 13:29:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-310ca9da-5d96-4828-9f71-e8cac1001cd2 tempest-SnapshotDependencyTests-306740303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.677s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:29:33 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-310ca9da-5d96-4828-9f71-e8cac1001cd2 tempest-SnapshotDependencyTests-306740303 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:29:33 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-310ca9da-5d96-4828-9f71-e8cac1001cd2 tempest-SnapshotDependencyTests-306740303 None] Deleted volume successfully.
Jul 03 13:29:33 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-310ca9da-5d96-4828-9f71-e8cac1001cd2 tempest-SnapshotDependencyTests-306740303 None] Lock "cinder-ca4f37ba-856a-4b8f-96b7-bfe6587bb7d7-delete_volume" released by "delete_volume" :: held 2.354s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:29:42 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:UPDATE=28,cinder:SELECT=21,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:29:43 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=26,cinder:UPDATE=28,cinder:DELETE=4,cinder:INSERT=6 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:29:56 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:29:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Flow 'volume_create_manager' (c256d85c-b516-4b6e-a6a5-3d1b95e4e816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:29:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a95c476e-56a5-4180-8d16-8dee1b07dccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:29:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a95c476e-56a5-4180-8d16-8dee1b07dccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-294634729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ef3af6-53a3-462b-a7f6-0de5429c1f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8d4fe10f484b91aa1fc4422b05cde7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:29:57Z,use_quota=True,user_id='2b582c4b94f7429ab6e89182333ff8a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:29:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dcf8bcd-e813-4d6b-a546-178606de3716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:29:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dcf8bcd-e813-4d6b-a546-178606de3716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:29:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1f9b739-9f3b-4f93-bbe0-e62077b405b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:29:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1f9b739-9f3b-4f93-bbe0-e62077b405b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16ef3af6-53a3-462b-a7f6-0de5429c1f0f', 'volume_name': 'volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:29:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41db33bd-eb7c-48a1-a99e-368e28da86b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:29:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41db33bd-eb7c-48a1-a99e-368e28da86b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:29:56 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6023c903-41c9-474e-a370-b3d67bc23160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:29:56 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Volume 16ef3af6-53a3-462b-a7f6-0de5429c1f0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f', 'volume_size': 1}
Jul 03 13:29:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:29:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:29:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-294634729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ef3af6-53a3-462b-a7f6-0de5429c1f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8d4fe10f484b91aa1fc4422b05cde7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:29:57Z,use_quota=True,user_id='2b582c4b94f7429ab6e89182333ff8a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:29:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Creating volume 16ef3af6-53a3-462b-a7f6-0de5429c1f0f {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:29:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:29:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:29:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:29:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:29:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:29:56 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:29:56 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:29:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:29:56 devstack sudo[108823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f 1073741824
Jul 03 13:29:56 devstack sudo[108823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:29:57 devstack sudo[108823]: pam_unix(sudo:session): session closed for user root
Jul 03 13:29:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f 1073741824" returned: 0 in 0.794s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:29:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:29:57 devstack sudo[108828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f
Jul 03 13:29:57 devstack sudo[108828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:29:58 devstack sudo[108828]: pam_unix(sudo:session): session closed for user root
Jul 03 13:29:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f" returned: 0 in 0.615s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:29:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:29:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:29:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6023c903-41c9-474e-a370-b3d67bc23160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:29:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (262dad43-d272-4d9b-8f1b-438024a0353a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:29:58 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Volume volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f (16ef3af6-53a3-462b-a7f6-0de5429c1f0f): created successfully
Jul 03 13:29:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (262dad43-d272-4d9b-8f1b-438024a0353a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:29:58 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Flow 'volume_create_manager' (c256d85c-b516-4b6e-a6a5-3d1b95e4e816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:29:58 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-0ea7a354-2397-410b-b673-a074f5cc5a37 tempest-ProjectMemberTests-1669144745 None] Created volume successfully.
Jul 03 13:29:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6d383784-599a-4cac-809a-2cac9d90be71 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:29:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6d383784-599a-4cac-809a-2cac9d90be71 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:29:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-6d383784-599a-4cac-809a-2cac9d90be71 tempest-ProjectMemberTests-1669144745 None] Creating offline snapshot 624a4292-0f73-4e0e-86ef-93ca207925c1 of volume 16ef3af6-53a3-462b-a7f6-0de5429c1f0f {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:29:58 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[111f59d1-3171-4b15-81dd-670b2fc71271]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:29:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6d383784-599a-4cac-809a-2cac9d90be71 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:29:58 devstack sudo[108832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f
Jul 03 13:29:58 devstack sudo[108832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:29:59 devstack sudo[108832]: pam_unix(sudo:session): session closed for user root
Jul 03 13:29:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6d383784-599a-4cac-809a-2cac9d90be71 tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f" returned: 0 in 0.746s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:29:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6d383784-599a-4cac-809a-2cac9d90be71 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f.624a4292-0f73-4e0e-86ef-93ca207925c1 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:29:59 devstack sudo[108837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f.624a4292-0f73-4e0e-86ef-93ca207925c1 1G
Jul 03 13:29:59 devstack sudo[108837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:00 devstack sudo[108837]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6d383784-599a-4cac-809a-2cac9d90be71 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f.624a4292-0f73-4e0e-86ef-93ca207925c1 1G" returned: 0 in 0.783s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6d383784-599a-4cac-809a-2cac9d90be71 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f.624a4292-0f73-4e0e-86ef-93ca207925c1 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:00 devstack sudo[108844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f.624a4292-0f73-4e0e-86ef-93ca207925c1
Jul 03 13:30:00 devstack sudo[108844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:01 devstack sudo[108844]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6d383784-599a-4cac-809a-2cac9d90be71 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f.624a4292-0f73-4e0e-86ef-93ca207925c1" returned: 0 in 0.684s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:01 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-6d383784-599a-4cac-809a-2cac9d90be71 tempest-ProjectMemberTests-1669144745 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f.624a4292-0f73-4e0e-86ef-93ca207925c1 is being set with open permissions: ugo+rw
Jul 03 13:30:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6d383784-599a-4cac-809a-2cac9d90be71 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f.624a4292-0f73-4e0e-86ef-93ca207925c1 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:01 devstack sudo[108849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f.624a4292-0f73-4e0e-86ef-93ca207925c1
Jul 03 13:30:01 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:01 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6d383784-599a-4cac-809a-2cac9d90be71 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f.624a4292-0f73-4e0e-86ef-93ca207925c1" returned: 0 in 0.620s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6d383784-599a-4cac-809a-2cac9d90be71 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:01 devstack sudo[108852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f.info
Jul 03 13:30:01 devstack sudo[108852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:02 devstack sudo[108852]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6d383784-599a-4cac-809a-2cac9d90be71 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f.info" returned: 0 in 0.627s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:02 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-6d383784-599a-4cac-809a-2cac9d90be71 tempest-ProjectMemberTests-1669144745 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f.info is being set with open permissions: ugo+rw
Jul 03 13:30:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6d383784-599a-4cac-809a-2cac9d90be71 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:02 devstack sudo[108855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f.info
Jul 03 13:30:02 devstack sudo[108855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:02 devstack sudo[108855]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-6d383784-599a-4cac-809a-2cac9d90be71 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f.info" returned: 0 in 0.621s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-6d383784-599a-4cac-809a-2cac9d90be71 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.155s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:30:02 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-6d383784-599a-4cac-809a-2cac9d90be71 tempest-ProjectMemberTests-1669144745 None] Create snapshot completed successfully
Jul 03 13:30:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0ecc48a3-4598-4ba6-b723-c5b5d92ed28f tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-624a4292-0f73-4e0e-86ef-93ca207925c1-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:30:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0ecc48a3-4598-4ba6-b723-c5b5d92ed28f tempest-ProjectMemberTests-1669144745 None] Lock "cinder-624a4292-0f73-4e0e-86ef-93ca207925c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:30:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0ecc48a3-4598-4ba6-b723-c5b5d92ed28f tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-quobyte-16ef3af6-53a3-462b-a7f6-0de5429c1f0f" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:30:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0ecc48a3-4598-4ba6-b723-c5b5d92ed28f tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-16ef3af6-53a3-462b-a7f6-0de5429c1f0f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:30:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0ecc48a3-4598-4ba6-b723-c5b5d92ed28f tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-quobyte-624a4292-0f73-4e0e-86ef-93ca207925c1" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:30:04 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0ecc48a3-4598-4ba6-b723-c5b5d92ed28f tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-624a4292-0f73-4e0e-86ef-93ca207925c1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:30:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-0ecc48a3-4598-4ba6-b723-c5b5d92ed28f tempest-ProjectMemberTests-1669144745 None] Deleting offline snapshot 624a4292-0f73-4e0e-86ef-93ca207925c1 of volume 16ef3af6-53a3-462b-a7f6-0de5429c1f0f {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:30:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-0ecc48a3-4598-4ba6-b723-c5b5d92ed28f tempest-ProjectMemberTests-1669144745 None] snapshot_file for this snap is: volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f.624a4292-0f73-4e0e-86ef-93ca207925c1 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:30:04 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b3800d-68b4-44df-a226-45c1ebc64eaf]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:30:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0ecc48a3-4598-4ba6-b723-c5b5d92ed28f tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f.624a4292-0f73-4e0e-86ef-93ca207925c1 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:04 devstack sudo[108860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f.624a4292-0f73-4e0e-86ef-93ca207925c1
Jul 03 13:30:04 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:04 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0ecc48a3-4598-4ba6-b723-c5b5d92ed28f tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f.624a4292-0f73-4e0e-86ef-93ca207925c1" returned: 0 in 0.741s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:04 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-0ecc48a3-4598-4ba6-b723-c5b5d92ed28f tempest-ProjectMemberTests-1669144745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:30:04 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[250a2a93-c801-49d5-b1c3-45d08b73018f]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:30:04 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0ecc48a3-4598-4ba6-b723-c5b5d92ed28f tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:04 devstack sudo[108865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f
Jul 03 13:30:04 devstack sudo[108865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:05 devstack sudo[108865]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0ecc48a3-4598-4ba6-b723-c5b5d92ed28f tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f" returned: 0 in 0.731s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:05 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0ecc48a3-4598-4ba6-b723-c5b5d92ed28f tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f.624a4292-0f73-4e0e-86ef-93ca207925c1 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:05 devstack sudo[108870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f.624a4292-0f73-4e0e-86ef-93ca207925c1
Jul 03 13:30:05 devstack sudo[108870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:06 devstack sudo[108870]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0ecc48a3-4598-4ba6-b723-c5b5d92ed28f tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f.624a4292-0f73-4e0e-86ef-93ca207925c1" returned: 0 in 0.739s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0ecc48a3-4598-4ba6-b723-c5b5d92ed28f tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f.624a4292-0f73-4e0e-86ef-93ca207925c1 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:06 devstack sudo[108875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f.624a4292-0f73-4e0e-86ef-93ca207925c1
Jul 03 13:30:06 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:06 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:06 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0ecc48a3-4598-4ba6-b723-c5b5d92ed28f tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f.624a4292-0f73-4e0e-86ef-93ca207925c1" returned: 0 in 0.634s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0ecc48a3-4598-4ba6-b723-c5b5d92ed28f tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-624a4292-0f73-4e0e-86ef-93ca207925c1" released by "_delete_snapshot" :: held 2.942s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:30:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0ecc48a3-4598-4ba6-b723-c5b5d92ed28f tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-16ef3af6-53a3-462b-a7f6-0de5429c1f0f" released by "delete_snapshot" :: held 2.966s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:30:07 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-0ecc48a3-4598-4ba6-b723-c5b5d92ed28f tempest-ProjectMemberTests-1669144745 None] Created reservations ['ab721e5c-a148-4ab6-9eb4-bc044a6266e6', '8b3cb2e0-aaea-4030-9e01-294d8c5e4b35', 'dbb6eb23-bdc7-4b0d-80f6-c36e5a9afa37', '7d1a4ede-1013-44b7-8333-a1eebee349cd'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:30:07 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-0ecc48a3-4598-4ba6-b723-c5b5d92ed28f tempest-ProjectMemberTests-1669144745 None] Delete snapshot completed successfully.
Jul 03 13:30:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0ecc48a3-4598-4ba6-b723-c5b5d92ed28f tempest-ProjectMemberTests-1669144745 None] Lock "cinder-624a4292-0f73-4e0e-86ef-93ca207925c1-delete_snapshot" released by "delete_snapshot" :: held 3.093s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:30:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d66327c5-c1d6-447d-a093-9f50d539bff3 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-16ef3af6-53a3-462b-a7f6-0de5429c1f0f-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:30:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d66327c5-c1d6-447d-a093-9f50d539bff3 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-16ef3af6-53a3-462b-a7f6-0de5429c1f0f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:30:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d66327c5-c1d6-447d-a093-9f50d539bff3 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-quobyte-16ef3af6-53a3-462b-a7f6-0de5429c1f0f" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:30:07 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d66327c5-c1d6-447d-a093-9f50d539bff3 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-16ef3af6-53a3-462b-a7f6-0de5429c1f0f" acquired by "delete_volume" :: waited 0.018s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:30:07 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfa05ad-f207-483c-89fa-91d3fea4576c]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:30:07 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d66327c5-c1d6-447d-a093-9f50d539bff3 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:07 devstack sudo[108878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f
Jul 03 13:30:07 devstack sudo[108878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:08 devstack sudo[108878]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d66327c5-c1d6-447d-a093-9f50d539bff3 tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f" returned: 0 in 0.765s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d66327c5-c1d6-447d-a093-9f50d539bff3 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:08 devstack sudo[108886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f
Jul 03 13:30:08 devstack sudo[108886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:08 devstack sudo[108886]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d66327c5-c1d6-447d-a093-9f50d539bff3 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-16ef3af6-53a3-462b-a7f6-0de5429c1f0f" returned: 0 in 0.630s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:08 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d66327c5-c1d6-447d-a093-9f50d539bff3 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-16ef3af6-53a3-462b-a7f6-0de5429c1f0f" released by "delete_volume" :: held 1.451s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:30:08 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-d66327c5-c1d6-447d-a093-9f50d539bff3 tempest-ProjectMemberTests-1669144745 None] Created reservations ['f47350a0-e688-48ac-9f25-daf975ac2217', '97ea1e5d-64dd-4dcb-ae1f-c2bdf883da28', 'e91b3ad3-a10a-4ec4-80a6-ad37070c6d86', '68e9250a-f534-4439-a7c6-07ca4294f8db'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:30:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d66327c5-c1d6-447d-a093-9f50d539bff3 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:30:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d66327c5-c1d6-447d-a093-9f50d539bff3 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:30:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d66327c5-c1d6-447d-a093-9f50d539bff3 tempest-ProjectMemberTests-1669144745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:30:08 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-d66327c5-c1d6-447d-a093-9f50d539bff3 tempest-ProjectMemberTests-1669144745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:30:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-d66327c5-c1d6-447d-a093-9f50d539bff3 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:30:08 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d66327c5-c1d6-447d-a093-9f50d539bff3 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:08 devstack sudo[108889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:30:08 devstack sudo[108889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:09 devstack sudo[108889]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d66327c5-c1d6-447d-a093-9f50d539bff3 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.661s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:09 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-d66327c5-c1d6-447d-a093-9f50d539bff3 tempest-ProjectMemberTests-1669144745 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:30:09 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-d66327c5-c1d6-447d-a093-9f50d539bff3 tempest-ProjectMemberTests-1669144745 None] Deleted volume successfully.
Jul 03 13:30:09 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d66327c5-c1d6-447d-a093-9f50d539bff3 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-16ef3af6-53a3-462b-a7f6-0de5429c1f0f-delete_volume" released by "delete_volume" :: held 2.305s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:30:09 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:30:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Flow 'volume_create_manager' (c1598311-82da-42ad-a6e8-cd429897f6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:30:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e0d549-46dc-44cd-bdeb-52ac921c2f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:30:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e0d549-46dc-44cd-bdeb-52ac921c2f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1736553523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b487ffc8-4b61-4919-b942-5ad0af66ea86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8d4fe10f484b91aa1fc4422b05cde7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:30:10Z,use_quota=True,user_id='2b582c4b94f7429ab6e89182333ff8a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:30:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c66263-cf44-4259-a7d1-f83541b4a4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:30:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c66263-cf44-4259-a7d1-f83541b4a4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:30:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17714e5b-6f13-4c31-aa3e-1a6d55337a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:30:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17714e5b-6f13-4c31-aa3e-1a6d55337a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b487ffc8-4b61-4919-b942-5ad0af66ea86', 'volume_name': 'volume-b487ffc8-4b61-4919-b942-5ad0af66ea86', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:30:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051fa900-7fb7-4e26-b67d-55c57f35c564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:30:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051fa900-7fb7-4e26-b67d-55c57f35c564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:30:09 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15a9c239-1319-4396-8d40-ef3b3a2bdceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:30:09 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Volume b487ffc8-4b61-4919-b942-5ad0af66ea86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b487ffc8-4b61-4919-b942-5ad0af66ea86', 'volume_size': 1}
Jul 03 13:30:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:30:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:30:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1736553523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b487ffc8-4b61-4919-b942-5ad0af66ea86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8d4fe10f484b91aa1fc4422b05cde7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:30:10Z,use_quota=True,user_id='2b582c4b94f7429ab6e89182333ff8a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:30:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Creating volume b487ffc8-4b61-4919-b942-5ad0af66ea86 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:30:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:30:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:30:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:30:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:30:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:30:09 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:30:09 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:30:09 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:09 devstack sudo[108892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86 1073741824
Jul 03 13:30:09 devstack sudo[108892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:10 devstack sudo[108892]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86 1073741824" returned: 0 in 0.783s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:10 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:10 devstack sudo[108897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86
Jul 03 13:30:10 devstack sudo[108897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:11 devstack sudo[108897]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86" returned: 0 in 0.664s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:11 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:30:11 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:30:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15a9c239-1319-4396-8d40-ef3b3a2bdceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b487ffc8-4b61-4919-b942-5ad0af66ea86', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:30:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (528406cb-d4fd-4161-a96e-9e752a0f35c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:30:11 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Volume volume-b487ffc8-4b61-4919-b942-5ad0af66ea86 (b487ffc8-4b61-4919-b942-5ad0af66ea86): created successfully
Jul 03 13:30:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (528406cb-d4fd-4161-a96e-9e752a0f35c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:30:11 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Flow 'volume_create_manager' (c1598311-82da-42ad-a6e8-cd429897f6bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:30:11 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-f49b88dc-fa57-4463-baae-5b99fbb3802e tempest-ProjectMemberTests-1669144745 None] Created volume successfully.
Jul 03 13:30:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ca4bbea9-a1d6-46cb-8afb-9ea518ef042c tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:30:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ca4bbea9-a1d6-46cb-8afb-9ea518ef042c tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:30:12 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-ca4bbea9-a1d6-46cb-8afb-9ea518ef042c tempest-ProjectMemberTests-1669144745 None] Creating offline snapshot 3a3520b9-995a-4a69-a9c3-f61826fdc589 of volume b487ffc8-4b61-4919-b942-5ad0af66ea86 {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:30:12 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[057075f4-f62d-4c4a-8fbd-929fda8d63ea]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:30:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ca4bbea9-a1d6-46cb-8afb-9ea518ef042c tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:12 devstack sudo[108901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86
Jul 03 13:30:12 devstack sudo[108901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:12 devstack sudo[108901]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ca4bbea9-a1d6-46cb-8afb-9ea518ef042c tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86" returned: 0 in 0.717s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:12 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ca4bbea9-a1d6-46cb-8afb-9ea518ef042c tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86.3a3520b9-995a-4a69-a9c3-f61826fdc589 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:12 devstack sudo[108906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86.3a3520b9-995a-4a69-a9c3-f61826fdc589 1G
Jul 03 13:30:12 devstack sudo[108906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:13 devstack sudo[108906]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ca4bbea9-a1d6-46cb-8afb-9ea518ef042c tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86.3a3520b9-995a-4a69-a9c3-f61826fdc589 1G" returned: 0 in 0.775s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:13 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ca4bbea9-a1d6-46cb-8afb-9ea518ef042c tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b487ffc8-4b61-4919-b942-5ad0af66ea86 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86.3a3520b9-995a-4a69-a9c3-f61826fdc589 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:13 devstack sudo[108912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b487ffc8-4b61-4919-b942-5ad0af66ea86 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86.3a3520b9-995a-4a69-a9c3-f61826fdc589
Jul 03 13:30:13 devstack sudo[108912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:14 devstack sudo[108912]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ca4bbea9-a1d6-46cb-8afb-9ea518ef042c tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b487ffc8-4b61-4919-b942-5ad0af66ea86 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86.3a3520b9-995a-4a69-a9c3-f61826fdc589" returned: 0 in 0.646s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:14 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-ca4bbea9-a1d6-46cb-8afb-9ea518ef042c tempest-ProjectMemberTests-1669144745 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86.3a3520b9-995a-4a69-a9c3-f61826fdc589 is being set with open permissions: ugo+rw
Jul 03 13:30:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ca4bbea9-a1d6-46cb-8afb-9ea518ef042c tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86.3a3520b9-995a-4a69-a9c3-f61826fdc589 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:14 devstack sudo[108917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86.3a3520b9-995a-4a69-a9c3-f61826fdc589
Jul 03 13:30:14 devstack sudo[108917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:14 devstack sudo[108917]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ca4bbea9-a1d6-46cb-8afb-9ea518ef042c tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86.3a3520b9-995a-4a69-a9c3-f61826fdc589" returned: 0 in 0.615s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ca4bbea9-a1d6-46cb-8afb-9ea518ef042c tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:14 devstack sudo[108920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86.info
Jul 03 13:30:14 devstack sudo[108920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:30:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:30:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:30:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:30:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:30:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:30:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:15 devstack sudo[108922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:30:15 devstack sudo[108922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:15 devstack sudo[108920]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ca4bbea9-a1d6-46cb-8afb-9ea518ef042c tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86.info" returned: 0 in 0.632s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:15 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-ca4bbea9-a1d6-46cb-8afb-9ea518ef042c tempest-ProjectMemberTests-1669144745 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86.info is being set with open permissions: ugo+rw
Jul 03 13:30:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ca4bbea9-a1d6-46cb-8afb-9ea518ef042c tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:15 devstack sudo[108925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86.info
Jul 03 13:30:15 devstack sudo[108925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:15 devstack sudo[108922]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.648s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:15 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:30:15 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:30:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 28 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:30:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>, <Thread(tpool_thread_0, started daemon 134850092431040)>, <Thread(tpool_thread_1, started daemon 134850084021952)>, <Thread(tpool_thread_2, started daemon 134850075612864)>, <Thread(tpool_thread_3, started daemon 134850067203776)>, <Thread(tpool_thread_4, started daemon 134850058794688)>, <Thread(tpool_thread_5, started daemon 134850050385600)>, <Thread(tpool_thread_6, started daemon 134850041976512)>, <Thread(tpool_thread_7, started daemon 134850033567424)>, <Thread(tpool_thread_8, started daemon 134850025158336)>, <Thread(tpool_thread_9, started daemon 134850016749248)>, <Thread(tpool_thread_10, started daemon 134850008340160)>, <Thread(tpool_thread_11, started daemon 134849999931072)>, <Thread(tpool_thread_12, started daemon 134849991521984)>, <Thread(tpool_thread_13, started daemon 134849983112896)>, <Thread(tpool_thread_14, started daemon 134849974703808)>, <Thread(tpool_thread_15, started daemon 134849966294720)>, <Thread(tpool_thread_16, started daemon 134849957885632)>, <Thread(tpool_thread_17, started daemon 134849949476544)>, <Thread(tpool_thread_18, started daemon 134849941067456)>, <Thread(tpool_thread_19, started daemon 134849932658368)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 13:30:16 devstack sudo[108925]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-ca4bbea9-a1d6-46cb-8afb-9ea518ef042c tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86.info" returned: 0 in 0.638s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:16 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-ca4bbea9-a1d6-46cb-8afb-9ea518ef042c tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.104s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:30:16 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-ca4bbea9-a1d6-46cb-8afb-9ea518ef042c tempest-ProjectMemberTests-1669144745 None] Create snapshot completed successfully
Jul 03 13:30:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d84c689d-b1ef-48bf-b9d1-09ac4c0ce9a7 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-3a3520b9-995a-4a69-a9c3-f61826fdc589-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:30:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d84c689d-b1ef-48bf-b9d1-09ac4c0ce9a7 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-3a3520b9-995a-4a69-a9c3-f61826fdc589-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:30:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d84c689d-b1ef-48bf-b9d1-09ac4c0ce9a7 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-quobyte-b487ffc8-4b61-4919-b942-5ad0af66ea86" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:30:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d84c689d-b1ef-48bf-b9d1-09ac4c0ce9a7 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-b487ffc8-4b61-4919-b942-5ad0af66ea86" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:30:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d84c689d-b1ef-48bf-b9d1-09ac4c0ce9a7 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-quobyte-3a3520b9-995a-4a69-a9c3-f61826fdc589" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:30:17 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d84c689d-b1ef-48bf-b9d1-09ac4c0ce9a7 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-3a3520b9-995a-4a69-a9c3-f61826fdc589" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:30:17 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-d84c689d-b1ef-48bf-b9d1-09ac4c0ce9a7 tempest-ProjectMemberTests-1669144745 None] Deleting offline snapshot 3a3520b9-995a-4a69-a9c3-f61826fdc589 of volume b487ffc8-4b61-4919-b942-5ad0af66ea86 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:30:17 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-d84c689d-b1ef-48bf-b9d1-09ac4c0ce9a7 tempest-ProjectMemberTests-1669144745 None] snapshot_file for this snap is: volume-b487ffc8-4b61-4919-b942-5ad0af66ea86.3a3520b9-995a-4a69-a9c3-f61826fdc589 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:30:17 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bff4962-0a3f-41cd-8a31-249e1f7d0d27]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:30:17 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d84c689d-b1ef-48bf-b9d1-09ac4c0ce9a7 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86.3a3520b9-995a-4a69-a9c3-f61826fdc589 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:17 devstack sudo[108929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86.3a3520b9-995a-4a69-a9c3-f61826fdc589
Jul 03 13:30:17 devstack sudo[108929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:18 devstack sudo[108929]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d84c689d-b1ef-48bf-b9d1-09ac4c0ce9a7 tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86.3a3520b9-995a-4a69-a9c3-f61826fdc589" returned: 0 in 0.726s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:18 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-d84c689d-b1ef-48bf-b9d1-09ac4c0ce9a7 tempest-ProjectMemberTests-1669144745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b487ffc8-4b61-4919-b942-5ad0af66ea86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:30:18 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[609fde66-61c1-45cf-bb3f-68506c60448a]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:30:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d84c689d-b1ef-48bf-b9d1-09ac4c0ce9a7 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:18 devstack sudo[108934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86
Jul 03 13:30:18 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:18 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d84c689d-b1ef-48bf-b9d1-09ac4c0ce9a7 tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86" returned: 0 in 0.782s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:18 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d84c689d-b1ef-48bf-b9d1-09ac4c0ce9a7 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86.3a3520b9-995a-4a69-a9c3-f61826fdc589 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:18 devstack sudo[108939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86.3a3520b9-995a-4a69-a9c3-f61826fdc589
Jul 03 13:30:18 devstack sudo[108939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:19 devstack sudo[108939]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d84c689d-b1ef-48bf-b9d1-09ac4c0ce9a7 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86.3a3520b9-995a-4a69-a9c3-f61826fdc589" returned: 0 in 0.719s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:19 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d84c689d-b1ef-48bf-b9d1-09ac4c0ce9a7 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86.3a3520b9-995a-4a69-a9c3-f61826fdc589 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:19 devstack sudo[108944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86.3a3520b9-995a-4a69-a9c3-f61826fdc589
Jul 03 13:30:19 devstack sudo[108944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:20 devstack sudo[108944]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-d84c689d-b1ef-48bf-b9d1-09ac4c0ce9a7 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86.3a3520b9-995a-4a69-a9c3-f61826fdc589" returned: 0 in 0.630s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d84c689d-b1ef-48bf-b9d1-09ac4c0ce9a7 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-3a3520b9-995a-4a69-a9c3-f61826fdc589" released by "_delete_snapshot" :: held 2.941s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:30:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d84c689d-b1ef-48bf-b9d1-09ac4c0ce9a7 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-b487ffc8-4b61-4919-b942-5ad0af66ea86" released by "delete_snapshot" :: held 2.967s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:30:20 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-d84c689d-b1ef-48bf-b9d1-09ac4c0ce9a7 tempest-ProjectMemberTests-1669144745 None] Created reservations ['a6d008f8-38cc-42ec-80cd-592a0a73d3eb', '833f4ef5-eaac-4b9b-8e5c-30b054632e25', '47607111-52d8-44a7-8f94-80653cf30037', 'a8b20272-bfe2-4894-b516-3d2879a90c53'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:30:20 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-d84c689d-b1ef-48bf-b9d1-09ac4c0ce9a7 tempest-ProjectMemberTests-1669144745 None] Delete snapshot completed successfully.
Jul 03 13:30:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-d84c689d-b1ef-48bf-b9d1-09ac4c0ce9a7 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-3a3520b9-995a-4a69-a9c3-f61826fdc589-delete_snapshot" released by "delete_snapshot" :: held 3.096s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:30:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cdccd4b1-478c-40e6-8b46-78b96e7a275c tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-b487ffc8-4b61-4919-b942-5ad0af66ea86-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:30:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cdccd4b1-478c-40e6-8b46-78b96e7a275c tempest-ProjectMemberTests-1669144745 None] Lock "cinder-b487ffc8-4b61-4919-b942-5ad0af66ea86-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:30:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cdccd4b1-478c-40e6-8b46-78b96e7a275c tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-quobyte-b487ffc8-4b61-4919-b942-5ad0af66ea86" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:30:20 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cdccd4b1-478c-40e6-8b46-78b96e7a275c tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-b487ffc8-4b61-4919-b942-5ad0af66ea86" acquired by "delete_volume" :: waited 0.014s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:30:20 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ef534b-743b-4a14-8633-cc198c999431]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:30:20 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cdccd4b1-478c-40e6-8b46-78b96e7a275c tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:20 devstack sudo[108947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86
Jul 03 13:30:20 devstack sudo[108947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:21 devstack sudo[108947]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cdccd4b1-478c-40e6-8b46-78b96e7a275c tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86" returned: 0 in 0.720s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cdccd4b1-478c-40e6-8b46-78b96e7a275c tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:21 devstack sudo[108952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86
Jul 03 13:30:21 devstack sudo[108952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:21 devstack sudo[108952]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:21 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cdccd4b1-478c-40e6-8b46-78b96e7a275c tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-b487ffc8-4b61-4919-b942-5ad0af66ea86" returned: 0 in 0.631s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:21 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cdccd4b1-478c-40e6-8b46-78b96e7a275c tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-b487ffc8-4b61-4919-b942-5ad0af66ea86" released by "delete_volume" :: held 1.400s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:30:21 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-cdccd4b1-478c-40e6-8b46-78b96e7a275c tempest-ProjectMemberTests-1669144745 None] Created reservations ['46722958-682d-4f8f-a012-0f7b196968ec', '4afc7ffc-3848-4b35-aec1-cf1fd11b4edd', '4b0774b4-ce85-4c94-932a-b6d317b3ebc9', '43c01a14-cde0-40c2-9f5c-009391423acd'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:30:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cdccd4b1-478c-40e6-8b46-78b96e7a275c tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:30:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cdccd4b1-478c-40e6-8b46-78b96e7a275c tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:30:22 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-cdccd4b1-478c-40e6-8b46-78b96e7a275c tempest-ProjectMemberTests-1669144745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:30:22 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-cdccd4b1-478c-40e6-8b46-78b96e7a275c tempest-ProjectMemberTests-1669144745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:30:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-cdccd4b1-478c-40e6-8b46-78b96e7a275c tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:30:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cdccd4b1-478c-40e6-8b46-78b96e7a275c tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:22 devstack sudo[108955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:30:22 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:22 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:22 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-cdccd4b1-478c-40e6-8b46-78b96e7a275c tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.631s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:22 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-cdccd4b1-478c-40e6-8b46-78b96e7a275c tempest-ProjectMemberTests-1669144745 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:30:22 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-cdccd4b1-478c-40e6-8b46-78b96e7a275c tempest-ProjectMemberTests-1669144745 None] Deleted volume successfully.
Jul 03 13:30:22 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-cdccd4b1-478c-40e6-8b46-78b96e7a275c tempest-ProjectMemberTests-1669144745 None] Lock "cinder-b487ffc8-4b61-4919-b942-5ad0af66ea86-delete_volume" released by "delete_volume" :: held 2.213s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:30:23 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:30:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Flow 'volume_create_manager' (05f723e2-1542-430e-be6a-a85def886822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:30:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9afd4dd6-9ce2-45ed-a9e4-74bebc74172d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:30:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9afd4dd6-9ce2-45ed-a9e4-74bebc74172d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-438661743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cec24d69-d2b6-479a-aac8-e8704813b57a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8d4fe10f484b91aa1fc4422b05cde7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:30:23Z,use_quota=True,user_id='2b582c4b94f7429ab6e89182333ff8a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:30:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6473ab3-04b6-4ec6-8170-79352359ed82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:30:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6473ab3-04b6-4ec6-8170-79352359ed82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:30:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82044130-ba2a-4f3b-b384-a0346570c47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:30:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82044130-ba2a-4f3b-b384-a0346570c47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cec24d69-d2b6-479a-aac8-e8704813b57a', 'volume_name': 'volume-cec24d69-d2b6-479a-aac8-e8704813b57a', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:30:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f6722d-39f8-48a7-90c0-8c514f3852c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:30:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f6722d-39f8-48a7-90c0-8c514f3852c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:30:23 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b96d1e-5b88-4a15-bda9-89210d4d3894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:30:23 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Volume cec24d69-d2b6-479a-aac8-e8704813b57a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cec24d69-d2b6-479a-aac8-e8704813b57a', 'volume_size': 1}
Jul 03 13:30:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:30:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:30:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-438661743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cec24d69-d2b6-479a-aac8-e8704813b57a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8d4fe10f484b91aa1fc4422b05cde7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:30:23Z,use_quota=True,user_id='2b582c4b94f7429ab6e89182333ff8a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:30:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Creating volume cec24d69-d2b6-479a-aac8-e8704813b57a {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:30:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:30:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:30:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:30:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:30:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:30:23 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:30:23 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:30:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:23 devstack sudo[108958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a 1073741824
Jul 03 13:30:23 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:23 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:23 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a 1073741824" returned: 0 in 0.764s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:24 devstack sudo[108964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a
Jul 03 13:30:24 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:24 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a" returned: 0 in 0.613s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:24 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:30:24 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:30:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b96d1e-5b88-4a15-bda9-89210d4d3894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cec24d69-d2b6-479a-aac8-e8704813b57a', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:30:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeff096a-964d-4339-ad46-990bf9e034e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:30:24 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Volume volume-cec24d69-d2b6-479a-aac8-e8704813b57a (cec24d69-d2b6-479a-aac8-e8704813b57a): created successfully
Jul 03 13:30:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeff096a-964d-4339-ad46-990bf9e034e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:30:24 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Flow 'volume_create_manager' (05f723e2-1542-430e-be6a-a85def886822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:30:24 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-2cb4205e-039b-41d9-954b-0c022be127aa tempest-ProjectMemberTests-1669144745 None] Created volume successfully.
Jul 03 13:30:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4f2ba222-2438-40e2-90ea-679be3085c72 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:30:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4f2ba222-2438-40e2-90ea-679be3085c72 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:30:25 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-4f2ba222-2438-40e2-90ea-679be3085c72 tempest-ProjectMemberTests-1669144745 None] Creating offline snapshot 22b19529-d658-44ed-9078-0adb1dc46a13 of volume cec24d69-d2b6-479a-aac8-e8704813b57a {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:30:25 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f587b2-1d09-423b-98c0-cc10d08777c9]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:30:25 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4f2ba222-2438-40e2-90ea-679be3085c72 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:25 devstack sudo[108973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a
Jul 03 13:30:25 devstack sudo[108973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:26 devstack sudo[108973]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4f2ba222-2438-40e2-90ea-679be3085c72 tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a" returned: 0 in 0.713s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4f2ba222-2438-40e2-90ea-679be3085c72 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a.22b19529-d658-44ed-9078-0adb1dc46a13 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:26 devstack sudo[108978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a.22b19529-d658-44ed-9078-0adb1dc46a13 1G
Jul 03 13:30:26 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:26 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4f2ba222-2438-40e2-90ea-679be3085c72 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a.22b19529-d658-44ed-9078-0adb1dc46a13 1G" returned: 0 in 0.732s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:26 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4f2ba222-2438-40e2-90ea-679be3085c72 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cec24d69-d2b6-479a-aac8-e8704813b57a -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a.22b19529-d658-44ed-9078-0adb1dc46a13 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:26 devstack sudo[108983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cec24d69-d2b6-479a-aac8-e8704813b57a -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a.22b19529-d658-44ed-9078-0adb1dc46a13
Jul 03 13:30:26 devstack sudo[108983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:27 devstack sudo[108983]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4f2ba222-2438-40e2-90ea-679be3085c72 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cec24d69-d2b6-479a-aac8-e8704813b57a -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a.22b19529-d658-44ed-9078-0adb1dc46a13" returned: 0 in 0.691s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:27 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-4f2ba222-2438-40e2-90ea-679be3085c72 tempest-ProjectMemberTests-1669144745 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a.22b19529-d658-44ed-9078-0adb1dc46a13 is being set with open permissions: ugo+rw
Jul 03 13:30:27 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4f2ba222-2438-40e2-90ea-679be3085c72 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a.22b19529-d658-44ed-9078-0adb1dc46a13 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:27 devstack sudo[108988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a.22b19529-d658-44ed-9078-0adb1dc46a13
Jul 03 13:30:27 devstack sudo[108988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:28 devstack sudo[108988]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4f2ba222-2438-40e2-90ea-679be3085c72 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a.22b19529-d658-44ed-9078-0adb1dc46a13" returned: 0 in 0.665s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4f2ba222-2438-40e2-90ea-679be3085c72 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:28 devstack sudo[109027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a.info
Jul 03 13:30:28 devstack sudo[109027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:28 devstack sudo[109027]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4f2ba222-2438-40e2-90ea-679be3085c72 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a.info" returned: 0 in 0.631s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:28 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-4f2ba222-2438-40e2-90ea-679be3085c72 tempest-ProjectMemberTests-1669144745 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a.info is being set with open permissions: ugo+rw
Jul 03 13:30:28 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4f2ba222-2438-40e2-90ea-679be3085c72 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:28 devstack sudo[109030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a.info
Jul 03 13:30:28 devstack sudo[109030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:29 devstack sudo[109030]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-4f2ba222-2438-40e2-90ea-679be3085c72 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a.info" returned: 0 in 0.645s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:29 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-4f2ba222-2438-40e2-90ea-679be3085c72 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.158s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:30:29 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-4f2ba222-2438-40e2-90ea-679be3085c72 tempest-ProjectMemberTests-1669144745 None] Create snapshot completed successfully
Jul 03 13:30:30 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0d2d0a80-8a0e-4e8b-b642-6e3d547d6ba3 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-22b19529-d658-44ed-9078-0adb1dc46a13-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:30:30 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0d2d0a80-8a0e-4e8b-b642-6e3d547d6ba3 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-22b19529-d658-44ed-9078-0adb1dc46a13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:30:30 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0d2d0a80-8a0e-4e8b-b642-6e3d547d6ba3 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-quobyte-cec24d69-d2b6-479a-aac8-e8704813b57a" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:30:30 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0d2d0a80-8a0e-4e8b-b642-6e3d547d6ba3 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-cec24d69-d2b6-479a-aac8-e8704813b57a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:30:30 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0d2d0a80-8a0e-4e8b-b642-6e3d547d6ba3 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-quobyte-22b19529-d658-44ed-9078-0adb1dc46a13" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:30:30 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0d2d0a80-8a0e-4e8b-b642-6e3d547d6ba3 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-22b19529-d658-44ed-9078-0adb1dc46a13" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:30:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-0d2d0a80-8a0e-4e8b-b642-6e3d547d6ba3 tempest-ProjectMemberTests-1669144745 None] Deleting offline snapshot 22b19529-d658-44ed-9078-0adb1dc46a13 of volume cec24d69-d2b6-479a-aac8-e8704813b57a {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:30:30 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-0d2d0a80-8a0e-4e8b-b642-6e3d547d6ba3 tempest-ProjectMemberTests-1669144745 None] snapshot_file for this snap is: volume-cec24d69-d2b6-479a-aac8-e8704813b57a.22b19529-d658-44ed-9078-0adb1dc46a13 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:30:30 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[78969542-d06f-4e51-8b5c-4a18368504c2]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:30:30 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0d2d0a80-8a0e-4e8b-b642-6e3d547d6ba3 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a.22b19529-d658-44ed-9078-0adb1dc46a13 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:30 devstack sudo[109033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a.22b19529-d658-44ed-9078-0adb1dc46a13
Jul 03 13:30:30 devstack sudo[109033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:31 devstack sudo[109033]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0d2d0a80-8a0e-4e8b-b642-6e3d547d6ba3 tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a.22b19529-d658-44ed-9078-0adb1dc46a13" returned: 0 in 0.738s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:31 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-0d2d0a80-8a0e-4e8b-b642-6e3d547d6ba3 tempest-ProjectMemberTests-1669144745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cec24d69-d2b6-479a-aac8-e8704813b57a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:30:31 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[522fece9-f2ff-47cd-9618-df0a14c27844]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:30:31 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0d2d0a80-8a0e-4e8b-b642-6e3d547d6ba3 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:31 devstack sudo[109038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a
Jul 03 13:30:31 devstack sudo[109038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:32 devstack sudo[109038]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0d2d0a80-8a0e-4e8b-b642-6e3d547d6ba3 tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a" returned: 0 in 0.755s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0d2d0a80-8a0e-4e8b-b642-6e3d547d6ba3 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a.22b19529-d658-44ed-9078-0adb1dc46a13 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:32 devstack sudo[109043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a.22b19529-d658-44ed-9078-0adb1dc46a13
Jul 03 13:30:32 devstack sudo[109043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:32 devstack sudo[109043]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0d2d0a80-8a0e-4e8b-b642-6e3d547d6ba3 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a.22b19529-d658-44ed-9078-0adb1dc46a13" returned: 0 in 0.701s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:32 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0d2d0a80-8a0e-4e8b-b642-6e3d547d6ba3 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a.22b19529-d658-44ed-9078-0adb1dc46a13 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:32 devstack sudo[109048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a.22b19529-d658-44ed-9078-0adb1dc46a13
Jul 03 13:30:32 devstack sudo[109048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:33 devstack sudo[109048]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0d2d0a80-8a0e-4e8b-b642-6e3d547d6ba3 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a.22b19529-d658-44ed-9078-0adb1dc46a13" returned: 0 in 0.640s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:33 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0d2d0a80-8a0e-4e8b-b642-6e3d547d6ba3 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-22b19529-d658-44ed-9078-0adb1dc46a13" released by "_delete_snapshot" :: held 2.922s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:30:33 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0d2d0a80-8a0e-4e8b-b642-6e3d547d6ba3 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-cec24d69-d2b6-479a-aac8-e8704813b57a" released by "delete_snapshot" :: held 2.947s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:30:33 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-0d2d0a80-8a0e-4e8b-b642-6e3d547d6ba3 tempest-ProjectMemberTests-1669144745 None] Created reservations ['ddc20a8c-8a2c-4f49-86d6-ccf52fd24200', '15a283c3-5d30-45d0-b743-1ad1dc643130', 'ca73611d-2408-490f-9f84-56b3f509cd24', 'd2986b4e-7270-4c1e-8ed8-fee0335d7fa1'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:30:33 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-0d2d0a80-8a0e-4e8b-b642-6e3d547d6ba3 tempest-ProjectMemberTests-1669144745 None] Delete snapshot completed successfully.
Jul 03 13:30:33 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0d2d0a80-8a0e-4e8b-b642-6e3d547d6ba3 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-22b19529-d658-44ed-9078-0adb1dc46a13-delete_snapshot" released by "delete_snapshot" :: held 3.086s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:30:33 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-57d06b6c-0c43-4112-8b71-1b987bedab7e tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-cec24d69-d2b6-479a-aac8-e8704813b57a-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:30:33 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-57d06b6c-0c43-4112-8b71-1b987bedab7e tempest-ProjectMemberTests-1669144745 None] Lock "cinder-cec24d69-d2b6-479a-aac8-e8704813b57a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:30:33 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-57d06b6c-0c43-4112-8b71-1b987bedab7e tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-quobyte-cec24d69-d2b6-479a-aac8-e8704813b57a" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:30:33 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-57d06b6c-0c43-4112-8b71-1b987bedab7e tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-cec24d69-d2b6-479a-aac8-e8704813b57a" acquired by "delete_volume" :: waited 0.015s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:30:33 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b34404-38f0-4a07-b09c-5fa3748cffb4]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:30:33 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-57d06b6c-0c43-4112-8b71-1b987bedab7e tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:33 devstack sudo[109052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a
Jul 03 13:30:33 devstack sudo[109052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:34 devstack sudo[109052]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-57d06b6c-0c43-4112-8b71-1b987bedab7e tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a" returned: 0 in 0.728s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:34 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-57d06b6c-0c43-4112-8b71-1b987bedab7e tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:34 devstack sudo[109057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a
Jul 03 13:30:34 devstack sudo[109057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:35 devstack sudo[109057]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-57d06b6c-0c43-4112-8b71-1b987bedab7e tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-cec24d69-d2b6-479a-aac8-e8704813b57a" returned: 0 in 0.658s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:35 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-57d06b6c-0c43-4112-8b71-1b987bedab7e tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-cec24d69-d2b6-479a-aac8-e8704813b57a" released by "delete_volume" :: held 1.438s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:30:35 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-57d06b6c-0c43-4112-8b71-1b987bedab7e tempest-ProjectMemberTests-1669144745 None] Created reservations ['1f3bb07f-ffb0-4b45-8ca8-f4f79fc7bf20', 'da23e89b-8356-4bf2-ab02-ad59b8621642', '8cb62782-8a38-4064-a697-f0a2a37db310', 'f2b3e34a-de5b-466d-93af-f777d4f348bd'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:30:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-57d06b6c-0c43-4112-8b71-1b987bedab7e tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:30:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-57d06b6c-0c43-4112-8b71-1b987bedab7e tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:30:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-57d06b6c-0c43-4112-8b71-1b987bedab7e tempest-ProjectMemberTests-1669144745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:30:35 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-57d06b6c-0c43-4112-8b71-1b987bedab7e tempest-ProjectMemberTests-1669144745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:30:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-57d06b6c-0c43-4112-8b71-1b987bedab7e tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:30:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-57d06b6c-0c43-4112-8b71-1b987bedab7e tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:35 devstack sudo[109060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:30:35 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:35 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:35 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-57d06b6c-0c43-4112-8b71-1b987bedab7e tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.624s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:35 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-57d06b6c-0c43-4112-8b71-1b987bedab7e tempest-ProjectMemberTests-1669144745 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:30:35 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-57d06b6c-0c43-4112-8b71-1b987bedab7e tempest-ProjectMemberTests-1669144745 None] Deleted volume successfully.
Jul 03 13:30:36 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-57d06b6c-0c43-4112-8b71-1b987bedab7e tempest-ProjectMemberTests-1669144745 None] Lock "cinder-cec24d69-d2b6-479a-aac8-e8704813b57a-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:30:36 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:30:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Flow 'volume_create_manager' (a9c943ba-f6a3-47e4-8cf3-72b151f136b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:30:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f38458b-af65-40d9-b356-d83c9e5aed12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:30:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f38458b-af65-40d9-b356-d83c9e5aed12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1832946952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c43ac32-246e-4574-b9cc-f7b921c287a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8d4fe10f484b91aa1fc4422b05cde7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:30:37Z,use_quota=True,user_id='2b582c4b94f7429ab6e89182333ff8a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:30:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (962ad7d3-3434-4425-adad-e2ff0281bc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:30:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (962ad7d3-3434-4425-adad-e2ff0281bc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:30:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b74601e-acd7-4c4a-99b4-4ba116ffaae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:30:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b74601e-acd7-4c4a-99b4-4ba116ffaae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c43ac32-246e-4574-b9cc-f7b921c287a3', 'volume_name': 'volume-8c43ac32-246e-4574-b9cc-f7b921c287a3', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:30:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe56708-c99f-4584-9335-662265fb135f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:30:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe56708-c99f-4584-9335-662265fb135f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:30:36 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3db1e51-286c-4262-be39-aa454dcc1a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:30:36 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Volume 8c43ac32-246e-4574-b9cc-f7b921c287a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c43ac32-246e-4574-b9cc-f7b921c287a3', 'volume_size': 1}
Jul 03 13:30:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:30:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:30:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1832946952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c43ac32-246e-4574-b9cc-f7b921c287a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8d4fe10f484b91aa1fc4422b05cde7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:30:37Z,use_quota=True,user_id='2b582c4b94f7429ab6e89182333ff8a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:30:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Creating volume 8c43ac32-246e-4574-b9cc-f7b921c287a3 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:30:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:30:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:30:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:30:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:30:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:30:36 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:30:36 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:30:36 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:36 devstack sudo[109063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3 1073741824
Jul 03 13:30:36 devstack sudo[109063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:37 devstack sudo[109063]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3 1073741824" returned: 0 in 0.799s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:37 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:37 devstack sudo[109069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3
Jul 03 13:30:37 devstack sudo[109069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:38 devstack sudo[109069]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3" returned: 0 in 0.640s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:38 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:30:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:30:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3db1e51-286c-4262-be39-aa454dcc1a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c43ac32-246e-4574-b9cc-f7b921c287a3', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:30:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (700b8da1-66df-48c0-a95b-0e38e79bd9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:30:38 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Volume volume-8c43ac32-246e-4574-b9cc-f7b921c287a3 (8c43ac32-246e-4574-b9cc-f7b921c287a3): created successfully
Jul 03 13:30:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (700b8da1-66df-48c0-a95b-0e38e79bd9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:30:38 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Flow 'volume_create_manager' (a9c943ba-f6a3-47e4-8cf3-72b151f136b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:30:38 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-f8dbeb92-9009-4cda-97c2-c9d1a788995e tempest-ProjectMemberTests-1669144745 None] Created volume successfully.
Jul 03 13:30:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5f96ac76-c9ee-40e6-9081-5f3610b501f2 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:30:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5f96ac76-c9ee-40e6-9081-5f3610b501f2 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:30:38 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-5f96ac76-c9ee-40e6-9081-5f3610b501f2 tempest-ProjectMemberTests-1669144745 None] Creating offline snapshot 2badc5f6-ab52-4c9f-8402-0cdaa79a7972 of volume 8c43ac32-246e-4574-b9cc-f7b921c287a3 {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:30:38 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[62df14f3-addd-4599-bf14-2cc5299ec366]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:30:38 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5f96ac76-c9ee-40e6-9081-5f3610b501f2 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:39 devstack sudo[109072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3
Jul 03 13:30:39 devstack sudo[109072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:39 devstack sudo[109072]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5f96ac76-c9ee-40e6-9081-5f3610b501f2 tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3" returned: 0 in 0.748s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:39 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5f96ac76-c9ee-40e6-9081-5f3610b501f2 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3.2badc5f6-ab52-4c9f-8402-0cdaa79a7972 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:39 devstack sudo[109077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3.2badc5f6-ab52-4c9f-8402-0cdaa79a7972 1G
Jul 03 13:30:39 devstack sudo[109077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:40 devstack sudo[109077]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5f96ac76-c9ee-40e6-9081-5f3610b501f2 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3.2badc5f6-ab52-4c9f-8402-0cdaa79a7972 1G" returned: 0 in 0.783s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:40 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5f96ac76-c9ee-40e6-9081-5f3610b501f2 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c43ac32-246e-4574-b9cc-f7b921c287a3 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3.2badc5f6-ab52-4c9f-8402-0cdaa79a7972 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:40 devstack sudo[109083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c43ac32-246e-4574-b9cc-f7b921c287a3 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3.2badc5f6-ab52-4c9f-8402-0cdaa79a7972
Jul 03 13:30:40 devstack sudo[109083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:41 devstack sudo[109083]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5f96ac76-c9ee-40e6-9081-5f3610b501f2 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c43ac32-246e-4574-b9cc-f7b921c287a3 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3.2badc5f6-ab52-4c9f-8402-0cdaa79a7972" returned: 0 in 0.692s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:41 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-5f96ac76-c9ee-40e6-9081-5f3610b501f2 tempest-ProjectMemberTests-1669144745 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3.2badc5f6-ab52-4c9f-8402-0cdaa79a7972 is being set with open permissions: ugo+rw
Jul 03 13:30:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5f96ac76-c9ee-40e6-9081-5f3610b501f2 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3.2badc5f6-ab52-4c9f-8402-0cdaa79a7972 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:41 devstack sudo[109088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3.2badc5f6-ab52-4c9f-8402-0cdaa79a7972
Jul 03 13:30:41 devstack sudo[109088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:41 devstack sudo[109088]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5f96ac76-c9ee-40e6-9081-5f3610b501f2 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3.2badc5f6-ab52-4c9f-8402-0cdaa79a7972" returned: 0 in 0.643s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:41 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5f96ac76-c9ee-40e6-9081-5f3610b501f2 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:41 devstack sudo[109091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3.info
Jul 03 13:30:41 devstack sudo[109091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:42 devstack sudo[109091]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5f96ac76-c9ee-40e6-9081-5f3610b501f2 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3.info" returned: 0 in 0.638s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:42 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-5f96ac76-c9ee-40e6-9081-5f3610b501f2 tempest-ProjectMemberTests-1669144745 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3.info is being set with open permissions: ugo+rw
Jul 03 13:30:42 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5f96ac76-c9ee-40e6-9081-5f3610b501f2 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:42 devstack sudo[109094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3.info
Jul 03 13:30:42 devstack sudo[109094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:43 devstack sudo[109094]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-5f96ac76-c9ee-40e6-9081-5f3610b501f2 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3.info" returned: 0 in 0.634s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:43 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-5f96ac76-c9ee-40e6-9081-5f3610b501f2 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.214s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:30:43 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-5f96ac76-c9ee-40e6-9081-5f3610b501f2 tempest-ProjectMemberTests-1669144745 None] Create snapshot completed successfully
Jul 03 13:30:44 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9f4bd5d4-b62d-4685-a319-540f20c66557 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-2badc5f6-ab52-4c9f-8402-0cdaa79a7972-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:30:44 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9f4bd5d4-b62d-4685-a319-540f20c66557 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-2badc5f6-ab52-4c9f-8402-0cdaa79a7972-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:30:44 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9f4bd5d4-b62d-4685-a319-540f20c66557 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-quobyte-8c43ac32-246e-4574-b9cc-f7b921c287a3" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:30:44 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9f4bd5d4-b62d-4685-a319-540f20c66557 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-8c43ac32-246e-4574-b9cc-f7b921c287a3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:30:44 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9f4bd5d4-b62d-4685-a319-540f20c66557 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-quobyte-2badc5f6-ab52-4c9f-8402-0cdaa79a7972" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:30:44 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9f4bd5d4-b62d-4685-a319-540f20c66557 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-2badc5f6-ab52-4c9f-8402-0cdaa79a7972" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:30:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-9f4bd5d4-b62d-4685-a319-540f20c66557 tempest-ProjectMemberTests-1669144745 None] Deleting offline snapshot 2badc5f6-ab52-4c9f-8402-0cdaa79a7972 of volume 8c43ac32-246e-4574-b9cc-f7b921c287a3 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:30:44 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-9f4bd5d4-b62d-4685-a319-540f20c66557 tempest-ProjectMemberTests-1669144745 None] snapshot_file for this snap is: volume-8c43ac32-246e-4574-b9cc-f7b921c287a3.2badc5f6-ab52-4c9f-8402-0cdaa79a7972 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:30:44 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ead223-9092-4e1a-ae25-846a5a4f2745]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:30:44 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9f4bd5d4-b62d-4685-a319-540f20c66557 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3.2badc5f6-ab52-4c9f-8402-0cdaa79a7972 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:44 devstack sudo[109098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3.2badc5f6-ab52-4c9f-8402-0cdaa79a7972
Jul 03 13:30:44 devstack sudo[109098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:45 devstack sudo[109098]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9f4bd5d4-b62d-4685-a319-540f20c66557 tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3.2badc5f6-ab52-4c9f-8402-0cdaa79a7972" returned: 0 in 0.762s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:45 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-9f4bd5d4-b62d-4685-a319-540f20c66557 tempest-ProjectMemberTests-1669144745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c43ac32-246e-4574-b9cc-f7b921c287a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:30:45 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bdeeaf-b786-48e5-85c6-f86b07773373]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:30:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9f4bd5d4-b62d-4685-a319-540f20c66557 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:45 devstack sudo[109103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3
Jul 03 13:30:45 devstack sudo[109103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:45 devstack sudo[109103]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9f4bd5d4-b62d-4685-a319-540f20c66557 tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3" returned: 0 in 0.741s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:45 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9f4bd5d4-b62d-4685-a319-540f20c66557 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3.2badc5f6-ab52-4c9f-8402-0cdaa79a7972 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:45 devstack sudo[109108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3.2badc5f6-ab52-4c9f-8402-0cdaa79a7972
Jul 03 13:30:45 devstack sudo[109108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:46 devstack sudo[109108]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9f4bd5d4-b62d-4685-a319-540f20c66557 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3.2badc5f6-ab52-4c9f-8402-0cdaa79a7972" returned: 0 in 0.710s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:46 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9f4bd5d4-b62d-4685-a319-540f20c66557 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3.2badc5f6-ab52-4c9f-8402-0cdaa79a7972 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:46 devstack sudo[109113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3.2badc5f6-ab52-4c9f-8402-0cdaa79a7972
Jul 03 13:30:46 devstack sudo[109113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:47 devstack sudo[109113]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-9f4bd5d4-b62d-4685-a319-540f20c66557 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3.2badc5f6-ab52-4c9f-8402-0cdaa79a7972" returned: 0 in 0.611s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9f4bd5d4-b62d-4685-a319-540f20c66557 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-2badc5f6-ab52-4c9f-8402-0cdaa79a7972" released by "_delete_snapshot" :: held 2.909s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:30:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9f4bd5d4-b62d-4685-a319-540f20c66557 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-8c43ac32-246e-4574-b9cc-f7b921c287a3" released by "delete_snapshot" :: held 2.931s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:30:47 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-9f4bd5d4-b62d-4685-a319-540f20c66557 tempest-ProjectMemberTests-1669144745 None] Created reservations ['8abbd3fb-8333-434a-b24d-99b5e0283302', '1c7f5baa-8795-4950-b1de-a3fc2fffe54e', 'f8efae70-4bd2-4f54-8b12-de7ab1d9e52a', 'abf12bb0-706a-4166-a2f4-03a9a125875a'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:30:47 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-9f4bd5d4-b62d-4685-a319-540f20c66557 tempest-ProjectMemberTests-1669144745 None] Delete snapshot completed successfully.
Jul 03 13:30:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-9f4bd5d4-b62d-4685-a319-540f20c66557 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-2badc5f6-ab52-4c9f-8402-0cdaa79a7972-delete_snapshot" released by "delete_snapshot" :: held 3.066s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:30:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a7d1f12e-ad96-49b3-9267-082749a46536 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-8c43ac32-246e-4574-b9cc-f7b921c287a3-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:30:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a7d1f12e-ad96-49b3-9267-082749a46536 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-8c43ac32-246e-4574-b9cc-f7b921c287a3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:30:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a7d1f12e-ad96-49b3-9267-082749a46536 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-quobyte-8c43ac32-246e-4574-b9cc-f7b921c287a3" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:30:47 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a7d1f12e-ad96-49b3-9267-082749a46536 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-8c43ac32-246e-4574-b9cc-f7b921c287a3" acquired by "delete_volume" :: waited 0.014s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:30:47 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e5d110-0751-4ef5-a74e-dba5008a859b]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:30:47 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a7d1f12e-ad96-49b3-9267-082749a46536 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:47 devstack sudo[109116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3
Jul 03 13:30:47 devstack sudo[109116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:48 devstack sudo[109116]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a7d1f12e-ad96-49b3-9267-082749a46536 tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3" returned: 0 in 0.748s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a7d1f12e-ad96-49b3-9267-082749a46536 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:48 devstack sudo[109121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3
Jul 03 13:30:48 devstack sudo[109121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:48 devstack sudo[109121]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:48 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a7d1f12e-ad96-49b3-9267-082749a46536 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8c43ac32-246e-4574-b9cc-f7b921c287a3" returned: 0 in 0.613s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:48 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a7d1f12e-ad96-49b3-9267-082749a46536 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-8c43ac32-246e-4574-b9cc-f7b921c287a3" released by "delete_volume" :: held 1.420s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:30:49 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-a7d1f12e-ad96-49b3-9267-082749a46536 tempest-ProjectMemberTests-1669144745 None] Created reservations ['d1c0b0dd-2fe7-4aff-b57d-c22552ac6b02', 'c25e0e80-8de3-4d75-8aeb-1e4504029964', '283b0e0a-80a1-4bcb-92a9-484beef59a8f', '5abfbd0f-a424-4e04-8ee2-2963cb9b907e'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:30:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a7d1f12e-ad96-49b3-9267-082749a46536 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:30:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a7d1f12e-ad96-49b3-9267-082749a46536 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:30:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a7d1f12e-ad96-49b3-9267-082749a46536 tempest-ProjectMemberTests-1669144745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:30:49 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-a7d1f12e-ad96-49b3-9267-082749a46536 tempest-ProjectMemberTests-1669144745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:30:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-a7d1f12e-ad96-49b3-9267-082749a46536 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:30:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a7d1f12e-ad96-49b3-9267-082749a46536 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:49 devstack sudo[109124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:30:49 devstack sudo[109124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:49 devstack sudo[109124]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:49 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-a7d1f12e-ad96-49b3-9267-082749a46536 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.642s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:49 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-a7d1f12e-ad96-49b3-9267-082749a46536 tempest-ProjectMemberTests-1669144745 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:30:49 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-a7d1f12e-ad96-49b3-9267-082749a46536 tempest-ProjectMemberTests-1669144745 None] Deleted volume successfully.
Jul 03 13:30:49 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-a7d1f12e-ad96-49b3-9267-082749a46536 tempest-ProjectMemberTests-1669144745 None] Lock "cinder-8c43ac32-246e-4574-b9cc-f7b921c287a3-delete_volume" released by "delete_volume" :: held 2.286s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:30:50 devstack cinder-volume[86837]: DEBUG cinder.volume.flows.manager.create_volume [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 13:30:50 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Flow 'volume_create_manager' (51f00aa9-0d17-4c5f-b53a-8a53dbe02545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:30:50 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (187face9-9d00-48b1-8f6e-92a9577304dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:30:50 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (187face9-9d00-48b1-8f6e-92a9577304dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1078014301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d444a91-507b-4412-8793-2456b96ce1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8d4fe10f484b91aa1fc4422b05cde7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:30:50Z,use_quota=True,user_id='2b582c4b94f7429ab6e89182333ff8a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:30:50 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (980bdf57-173f-4045-832d-589ccf7ba956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:30:50 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (980bdf57-173f-4045-832d-589ccf7ba956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:30:50 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302fcf45-e98a-47bd-ae39-5d3a7235382d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:30:50 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302fcf45-e98a-47bd-ae39-5d3a7235382d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d444a91-507b-4412-8793-2456b96ce1b2', 'volume_name': 'volume-8d444a91-507b-4412-8793-2456b96ce1b2', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:30:50 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e637bd-34fa-4c5c-b115-d15f75110e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:30:50 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e637bd-34fa-4c5c-b115-d15f75110e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:30:50 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42763536-5fda-4e84-85aa-db457bd657a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:30:50 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Volume 8d444a91-507b-4412-8793-2456b96ce1b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d444a91-507b-4412-8793-2456b96ce1b2', 'volume_size': 1}
Jul 03 13:30:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:30:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:30:50 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7aa53cbf7cb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T11:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1078014301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d444a91-507b-4412-8793-2456b96ce1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b8d4fe10f484b91aa1fc4422b05cde7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T11:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T11:30:50Z,use_quota=True,user_id='2b582c4b94f7429ab6e89182333ff8a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75555192-d86e-4af0-b4b4-2853cfffe453),volume_type_id=75555192-d86e-4af0-b4b4-2853cfffe453)}" {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 13:30:50 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Creating volume 8d444a91-507b-4412-8793-2456b96ce1b2 {{(pid=86837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 13:30:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:30:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:30:50 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:30:50 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:30:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:30:50 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Selected osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db as target Quobyte volume. {{(pid=86837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 13:30:50 devstack cinder-volume[86837]: INFO cinder.volume.drivers.remotefs [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] casted to osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db
Jul 03 13:30:50 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2 1073741824 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:50 devstack sudo[109127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2 1073741824
Jul 03 13:30:50 devstack sudo[109127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:51 devstack sudo[109127]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2 1073741824" returned: 0 in 0.825s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:51 devstack sudo[109134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2
Jul 03 13:30:51 devstack sudo[109134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:51 devstack sudo[109134]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2" returned: 0 in 0.641s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:51 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'} {{(pid=86837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 13:30:51 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:30:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42763536-5fda-4e84-85aa-db457bd657a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d444a91-507b-4412-8793-2456b96ce1b2', 'volume_size': 1}' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:30:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec790d4-5efb-4633-b46d-84246a0aca26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 13:30:51 devstack cinder-volume[86837]: INFO cinder.volume.flows.manager.create_volume [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Volume volume-8d444a91-507b-4412-8793-2456b96ce1b2 (8d444a91-507b-4412-8793-2456b96ce1b2): created successfully
Jul 03 13:30:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec790d4-5efb-4633-b46d-84246a0aca26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 13:30:51 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Flow 'volume_create_manager' (51f00aa9-0d17-4c5f-b53a-8a53dbe02545) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 13:30:51 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-46c10809-c47d-40cc-8896-73427d7f7e59 tempest-ProjectMemberTests-1669144745 None] Created volume successfully.
Jul 03 13:30:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-54bf2d84-3b40-481c-8e26-7095fbb31228 tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:30:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-54bf2d84-3b40-481c-8e26-7095fbb31228 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:30:52 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-54bf2d84-3b40-481c-8e26-7095fbb31228 tempest-ProjectMemberTests-1669144745 None] Creating offline snapshot fe02b7ab-16ce-4056-8b60-12694cd54ee4 of volume 8d444a91-507b-4412-8793-2456b96ce1b2 {{(pid=86837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 13:30:52 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[293b4050-cde3-4178-8bff-00090ddbb567]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:30:52 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-54bf2d84-3b40-481c-8e26-7095fbb31228 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:52 devstack sudo[109137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2
Jul 03 13:30:52 devstack sudo[109137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:53 devstack sudo[109137]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-54bf2d84-3b40-481c-8e26-7095fbb31228 tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2" returned: 0 in 0.731s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-54bf2d84-3b40-481c-8e26-7095fbb31228 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2.fe02b7ab-16ce-4056-8b60-12694cd54ee4 1G {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:53 devstack sudo[109142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2.fe02b7ab-16ce-4056-8b60-12694cd54ee4 1G
Jul 03 13:30:53 devstack sudo[109142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:53 devstack sudo[109142]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-54bf2d84-3b40-481c-8e26-7095fbb31228 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2.fe02b7ab-16ce-4056-8b60-12694cd54ee4 1G" returned: 0 in 0.772s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:53 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-54bf2d84-3b40-481c-8e26-7095fbb31228 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d444a91-507b-4412-8793-2456b96ce1b2 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2.fe02b7ab-16ce-4056-8b60-12694cd54ee4 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:53 devstack sudo[109148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d444a91-507b-4412-8793-2456b96ce1b2 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2.fe02b7ab-16ce-4056-8b60-12694cd54ee4
Jul 03 13:30:53 devstack sudo[109148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:54 devstack sudo[109148]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-54bf2d84-3b40-481c-8e26-7095fbb31228 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d444a91-507b-4412-8793-2456b96ce1b2 -F qcow2 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2.fe02b7ab-16ce-4056-8b60-12694cd54ee4" returned: 0 in 0.673s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:54 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-54bf2d84-3b40-481c-8e26-7095fbb31228 tempest-ProjectMemberTests-1669144745 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2.fe02b7ab-16ce-4056-8b60-12694cd54ee4 is being set with open permissions: ugo+rw
Jul 03 13:30:54 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-54bf2d84-3b40-481c-8e26-7095fbb31228 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2.fe02b7ab-16ce-4056-8b60-12694cd54ee4 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:54 devstack sudo[109153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2.fe02b7ab-16ce-4056-8b60-12694cd54ee4
Jul 03 13:30:54 devstack sudo[109153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:55 devstack sudo[109153]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-54bf2d84-3b40-481c-8e26-7095fbb31228 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2.fe02b7ab-16ce-4056-8b60-12694cd54ee4" returned: 0 in 0.634s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:55 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:UPDATE=80,cinder:INSERT=19,cinder:DELETE=4,cinder:SELECT=61 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:30:55 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=59,cinder:UPDATE=73,cinder:DELETE=9,cinder:INSERT=22 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:30:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-54bf2d84-3b40-481c-8e26-7095fbb31228 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:55 devstack sudo[109156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2.info
Jul 03 13:30:55 devstack sudo[109156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:55 devstack sudo[109156]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-54bf2d84-3b40-481c-8e26-7095fbb31228 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2.info" returned: 0 in 0.632s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:55 devstack cinder-volume[86837]: WARNING cinder.volume.drivers.remotefs [None req-54bf2d84-3b40-481c-8e26-7095fbb31228 tempest-ProjectMemberTests-1669144745 None] /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2.info is being set with open permissions: ugo+rw
Jul 03 13:30:55 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-54bf2d84-3b40-481c-8e26-7095fbb31228 tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2.info {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:55 devstack sudo[109159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2.info
Jul 03 13:30:55 devstack sudo[109159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:56 devstack sudo[109159]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-54bf2d84-3b40-481c-8e26-7095fbb31228 tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2.info" returned: 0 in 0.652s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:56 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-54bf2d84-3b40-481c-8e26-7095fbb31228 tempest-ProjectMemberTests-1669144745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.173s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:30:56 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-54bf2d84-3b40-481c-8e26-7095fbb31228 tempest-ProjectMemberTests-1669144745 None] Create snapshot completed successfully
Jul 03 13:30:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-72a6ca23-0075-453e-b355-83661bd186bd tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-fe02b7ab-16ce-4056-8b60-12694cd54ee4-delete_snapshot" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:30:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-72a6ca23-0075-453e-b355-83661bd186bd tempest-ProjectMemberTests-1669144745 None] Lock "cinder-fe02b7ab-16ce-4056-8b60-12694cd54ee4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:30:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-72a6ca23-0075-453e-b355-83661bd186bd tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-quobyte-8d444a91-507b-4412-8793-2456b96ce1b2" by "delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:30:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-72a6ca23-0075-453e-b355-83661bd186bd tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-8d444a91-507b-4412-8793-2456b96ce1b2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:30:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-72a6ca23-0075-453e-b355-83661bd186bd tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-quobyte-fe02b7ab-16ce-4056-8b60-12694cd54ee4" by "_delete_snapshot" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:30:57 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-72a6ca23-0075-453e-b355-83661bd186bd tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-fe02b7ab-16ce-4056-8b60-12694cd54ee4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:30:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-72a6ca23-0075-453e-b355-83661bd186bd tempest-ProjectMemberTests-1669144745 None] Deleting offline snapshot fe02b7ab-16ce-4056-8b60-12694cd54ee4 of volume 8d444a91-507b-4412-8793-2456b96ce1b2 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 13:30:57 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-72a6ca23-0075-453e-b355-83661bd186bd tempest-ProjectMemberTests-1669144745 None] snapshot_file for this snap is: volume-8d444a91-507b-4412-8793-2456b96ce1b2.fe02b7ab-16ce-4056-8b60-12694cd54ee4 {{(pid=86837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 13:30:57 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf26ccea-7fac-4bbc-ac2d-c07359ca781f]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:30:57 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-72a6ca23-0075-453e-b355-83661bd186bd tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2.fe02b7ab-16ce-4056-8b60-12694cd54ee4 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:57 devstack sudo[109163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2.fe02b7ab-16ce-4056-8b60-12694cd54ee4
Jul 03 13:30:57 devstack sudo[109163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:58 devstack sudo[109163]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-72a6ca23-0075-453e-b355-83661bd186bd tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2.fe02b7ab-16ce-4056-8b60-12694cd54ee4" returned: 0 in 0.764s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:58 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.remotefs [None req-72a6ca23-0075-453e-b355-83661bd186bd tempest-ProjectMemberTests-1669144745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d444a91-507b-4412-8793-2456b96ce1b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 13:30:58 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a93c39-864b-494d-8398-155502c1e569]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:30:58 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-72a6ca23-0075-453e-b355-83661bd186bd tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:58 devstack sudo[109168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2
Jul 03 13:30:58 devstack sudo[109168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:59 devstack sudo[109168]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-72a6ca23-0075-453e-b355-83661bd186bd tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2" returned: 0 in 0.722s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-72a6ca23-0075-453e-b355-83661bd186bd tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2.fe02b7ab-16ce-4056-8b60-12694cd54ee4 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:30:59 devstack sudo[109173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2.fe02b7ab-16ce-4056-8b60-12694cd54ee4
Jul 03 13:30:59 devstack sudo[109173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:30:59 devstack sudo[109173]: pam_unix(sudo:session): session closed for user root
Jul 03 13:30:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-72a6ca23-0075-453e-b355-83661bd186bd tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2.fe02b7ab-16ce-4056-8b60-12694cd54ee4" returned: 0 in 0.734s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:30:59 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-72a6ca23-0075-453e-b355-83661bd186bd tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2.fe02b7ab-16ce-4056-8b60-12694cd54ee4 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:31:00 devstack sudo[109178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2.fe02b7ab-16ce-4056-8b60-12694cd54ee4
Jul 03 13:31:00 devstack sudo[109178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:31:00 devstack sudo[109178]: pam_unix(sudo:session): session closed for user root
Jul 03 13:31:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-72a6ca23-0075-453e-b355-83661bd186bd tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2.fe02b7ab-16ce-4056-8b60-12694cd54ee4" returned: 0 in 0.658s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:31:00 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-72a6ca23-0075-453e-b355-83661bd186bd tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-fe02b7ab-16ce-4056-8b60-12694cd54ee4" released by "_delete_snapshot" :: held 2.969s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:31:00 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-72a6ca23-0075-453e-b355-83661bd186bd tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-8d444a91-507b-4412-8793-2456b96ce1b2" released by "delete_snapshot" :: held 2.992s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:31:00 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-72a6ca23-0075-453e-b355-83661bd186bd tempest-ProjectMemberTests-1669144745 None] Created reservations ['b5e29100-d7f7-48a3-8664-45196ce62e65', 'fade3db2-90c8-46fa-9b16-cf94a16c6757', '26b54b5a-1bff-4d13-8675-82de7786116c', '5917f9ae-74c5-47ba-9e54-fd077146f889'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:31:00 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-72a6ca23-0075-453e-b355-83661bd186bd tempest-ProjectMemberTests-1669144745 None] Delete snapshot completed successfully.
Jul 03 13:31:00 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-72a6ca23-0075-453e-b355-83661bd186bd tempest-ProjectMemberTests-1669144745 None] Lock "cinder-fe02b7ab-16ce-4056-8b60-12694cd54ee4-delete_snapshot" released by "delete_snapshot" :: held 3.125s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:31:00 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0949efaf-5083-4017-a65d-b72fb0ec65da tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-8d444a91-507b-4412-8793-2456b96ce1b2-delete_volume" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:31:00 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0949efaf-5083-4017-a65d-b72fb0ec65da tempest-ProjectMemberTests-1669144745 None] Lock "cinder-8d444a91-507b-4412-8793-2456b96ce1b2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:31:00 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0949efaf-5083-4017-a65d-b72fb0ec65da tempest-ProjectMemberTests-1669144745 None] Acquiring lock "cinder-quobyte-8d444a91-507b-4412-8793-2456b96ce1b2" by "delete_volume" {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 13:31:00 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0949efaf-5083-4017-a65d-b72fb0ec65da tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-8d444a91-507b-4412-8793-2456b96ce1b2" acquired by "delete_volume" :: waited 0.020s {{(pid=86837) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 13:31:00 devstack cinder-volume[86837]: DEBUG oslo.privsep.daemon [-] privsep: reply[4549c348-4fcd-43af-9a72-e16b73c9256c]: (4, 'qcow2') {{(pid=87940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 13:31:00 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0949efaf-5083-4017-a65d-b72fb0ec65da tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:31:01 devstack sudo[109183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2
Jul 03 13:31:01 devstack sudo[109183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:31:01 devstack sudo[109183]: pam_unix(sudo:session): session closed for user root
Jul 03 13:31:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0949efaf-5083-4017-a65d-b72fb0ec65da tempest-ProjectMemberTests-1669144745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2" returned: 0 in 0.736s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:31:01 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0949efaf-5083-4017-a65d-b72fb0ec65da tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2 {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:31:01 devstack sudo[109188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2
Jul 03 13:31:01 devstack sudo[109188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:31:02 devstack sudo[109188]: pam_unix(sudo:session): session closed for user root
Jul 03 13:31:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0949efaf-5083-4017-a65d-b72fb0ec65da tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff/volume-8d444a91-507b-4412-8793-2456b96ce1b2" returned: 0 in 0.643s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:31:02 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0949efaf-5083-4017-a65d-b72fb0ec65da tempest-ProjectMemberTests-1669144745 None] Lock "cinder-quobyte-8d444a91-507b-4412-8793-2456b96ce1b2" released by "delete_volume" :: held 1.437s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:31:02 devstack cinder-volume[86837]: DEBUG cinder.quota [None req-0949efaf-5083-4017-a65d-b72fb0ec65da tempest-ProjectMemberTests-1669144745 None] Created reservations ['23d0bbba-07f9-4286-b489-c0f11f75c0bb', '79e83a25-77a6-4a0d-b2d3-35bea86b95d6', 'f78bb636-be8e-4bd7-85ef-dc0ae0ad61ce', '1c76fc99-04a5-43e9-8b2a-9c6f2076a370'] {{(pid=86837) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 13:31:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0949efaf-5083-4017-a65d-b72fb0ec65da tempest-ProjectMemberTests-1669144745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:31:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0949efaf-5083-4017-a65d-b72fb0ec65da tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:31:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0949efaf-5083-4017-a65d-b72fb0ec65da tempest-ProjectMemberTests-1669144745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:31:02 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-0949efaf-5083-4017-a65d-b72fb0ec65da tempest-ProjectMemberTests-1669144745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:31:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-0949efaf-5083-4017-a65d-b72fb0ec65da tempest-ProjectMemberTests-1669144745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:31:02 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0949efaf-5083-4017-a65d-b72fb0ec65da tempest-ProjectMemberTests-1669144745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:31:02 devstack sudo[109191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:31:02 devstack sudo[109191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:31:03 devstack sudo[109191]: pam_unix(sudo:session): session closed for user root
Jul 03 13:31:03 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-0949efaf-5083-4017-a65d-b72fb0ec65da tempest-ProjectMemberTests-1669144745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.630s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:31:03 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-0949efaf-5083-4017-a65d-b72fb0ec65da tempest-ProjectMemberTests-1669144745 None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:31:03 devstack cinder-volume[86837]: INFO cinder.volume.manager [None req-0949efaf-5083-4017-a65d-b72fb0ec65da tempest-ProjectMemberTests-1669144745 None] Deleted volume successfully.
Jul 03 13:31:03 devstack cinder-volume[86837]: DEBUG cinder.coordination [None req-0949efaf-5083-4017-a65d-b72fb0ec65da tempest-ProjectMemberTests-1669144745 None] Lock "cinder-8d444a91-507b-4412-8793-2456b96ce1b2-delete_volume" released by "delete_volume" :: held 2.264s {{(pid=86837) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 13:31:12 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=13,cinder:INSERT=3,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:31:13 devstack cinder-volume[86837]: DEBUG dbcounter [-] [86837] Writing DB stats cinder:SELECT=8,cinder:INSERT=6,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=86837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 13:31:14 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:31:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 13:31:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 13:31:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db': None} {{(pid=86837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 13:31:14 devstack cinder-volume[86837]: DEBUG cinder.volume.drivers.quobyte [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1390e09c-6590-4ac0-bcaf-81031883b4db'] {{(pid=86837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 13:31:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.lockutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 13:31:14 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 13:31:15 devstack sudo[109198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff
Jul 03 13:31:15 devstack sudo[109198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 13:31:15 devstack sudo[109198]: pam_unix(sudo:session): session closed for user root
Jul 03 13:31:15 devstack cinder-volume[86837]: DEBUG oslo_concurrency.processutils [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee15631afdfdf9ceaf090985a5e315ff" returned: 0 in 0.630s {{(pid=86837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 13:31:15 devstack cinder-volume[86837]: DEBUG cinder.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Notifying Schedulers of capabilities ... {{(pid=86837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 13:31:15 devstack cinder-volume[86837]: DEBUG oslo_service.periodic_task [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 13:31:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread count: 28 {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 13:31:15 devstack cinder-volume[86837]: DEBUG cinder.volume.manager [None req-f6e7ebb6-413d-48f9-9ec6-1c00457b83b0 None None] thread info: [<_MainThread(MainThread, started 134850216562816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134850110291712)>, <Thread(Thread-3 (stat_writer), started daemon 134850106229376)>, <Thread(Rabbit-heartbeat, started daemon 134850105410176)>, <Thread(Thread-5 (_runner), started daemon 134850105267648)>, <Thread(Thread-7 (_runner), started daemon 134850103107136)>, <Thread(fd_logger, started daemon 134850101604352)>, <Thread(privsep_reader, started daemon 134850102724928)>, <Thread(tpool_thread_0, started daemon 134850092431040)>, <Thread(tpool_thread_1, started daemon 134850084021952)>, <Thread(tpool_thread_2, started daemon 134850075612864)>, <Thread(tpool_thread_3, started daemon 134850067203776)>, <Thread(tpool_thread_4, started daemon 134850058794688)>, <Thread(tpool_thread_5, started daemon 134850050385600)>, <Thread(tpool_thread_6, started daemon 134850041976512)>, <Thread(tpool_thread_7, started daemon 134850033567424)>, <Thread(tpool_thread_8, started daemon 134850025158336)>, <Thread(tpool_thread_9, started daemon 134850016749248)>, <Thread(tpool_thread_10, started daemon 134850008340160)>, <Thread(tpool_thread_11, started daemon 134849999931072)>, <Thread(tpool_thread_12, started daemon 134849991521984)>, <Thread(tpool_thread_13, started daemon 134849983112896)>, <Thread(tpool_thread_14, started daemon 134849974703808)>, <Thread(tpool_thread_15, started daemon 134849966294720)>, <Thread(tpool_thread_16, started daemon 134849957885632)>, <Thread(tpool_thread_17, started daemon 134849949476544)>, <Thread(tpool_thread_18, started daemon 134849941067456)>, <Thread(tpool_thread_19, started daemon 134849932658368)>] {{(pid=86837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}